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TAILORED  TRAINING  IN  VEHICLE  MAINTENANCE  COURSES 


EXECUTIVE  SUMMARY 


Research  Requirement: 

A  central  tenet  within  the  Army  Learning  Concept  2015  (ALC  2015)  and  Anny  Learning 
Model  (ALM)  is  the  need  to  transition  to  learner-centric  methods  and  processes  that  develop 
critical  competencies  through  rigorous,  tailored,  outcome-oriented  learning  experiences.  The 
ALM  also  emphasizes  the  use  of  pretests  and  training  assessments  to  effectively  predict  and 
tailor  training  to  individual  Soldiers’  needs  as  defined  by  their  experiences  and  proven 
competencies.  Previous  research  conducted  by  the  U.S.  Army  Research  Institute  (ARI)  Ft. 
Benning  Research  Unit  showed  that  tailored  training  in  the  Anny  is  most  likely  to  occur  in 
technical,  functional  courses  where  graduates  must  be  proficient  in  clearly  defined  skills,  based 
on  specified  performance  standards,  upon  graduation.  However,  there  has  been  little  research 
focused  on  identifying  the  actual  different  tailored  training  strategies  employed  in  divided  small 
group  training  based  interpersonal  interactions  or  how  the  nature  and  frequency  of  these 
interactions  affect  subsequent  student  learning  or  task  perfonnance.  This  effort  addresses  gaps 
identified  in  previous  research  conducted  on  tailored  training  approaches  and  examines  specific 
training  issues  raised  by  the  3-8 1st  AR  BN  at  Fort  Benning,  GA.  The  first  objective  of  the 
research  is  to  identify  potential  predictors  of  performance  at  different  stages  of  training  in  the 
91 A  and  91M  AIT  courses  that  will  enable  instructors  to  better  identify  strong  and  weak 
Soldiers.  The  second  objective  is  to  examine  small  group  processes  in  both  courses  to  identify 
the  nature  and  extent  of  tailored  training,  peer-to-peer  interaction,  and  how  tailoring  varies  with 
group  composition.  The  final  objective  is  to  examine  the  effectiveness  and  other  impacts  of  the 
Blended  Rotation  Interactive  Technology  Environment  (BRITE)  technologies  employed  in 
training  (91M  course  only). 

Procedure: 

Following  approval  of  the  initial  research  proposal  and  participating  AIT  units  by  DCG- 
IMT,  this  research  effort  was  completed  in  two  phases.  During  Phase  1,  researchers  assessed  the 
utility  of  demographic  characteristics,  prior  knowledge,  and  cognitive  measures  for  predicting 
later  perfonnance  in  Abrams  tank  and  BFV  maintainers’  training.  Based  upon  training  schedules 
and  class  availability,  this  data,  as  well  as  unit  documented  training  outcomes,  were  collected 
from  five  consecutive  91A  and  three  consecutive  91M  classes.  In  Phase  2,  researchers  expanded 
this  effort  by  collecting  data  on  instructional  methodologies  and  techniques,  tailored  training 
strategies,  and  student  perfonnance  and  interactions  through  direct  observation  of  scheduled 
training  events  and  activities  and  unit  provided  training  summaries  and  records.  Training  was 
observed  during  three  one-week  periods  a  week  after  the  assignment  of  Soldiers  to  their  training 
groups  and  the  initiation.  Following  the  completion  of  all  training  observations,  focus  group 
interviews  were  conducted  with  the  participating  students  and  instructors. 


IV 


Findings: 

Our  analyses  showed  that  traditionally  available  measures,  e.g.  GT  scores,  are  not  strong 
predictors  of  later  student  perfonnance.  Our  research  indicated  that  measures  designed  to 
discern  a  student’s  entering  knowledge  of  and  ability  to  complete  basic  underlying  tasks  relevant 
to  later  learning  content  are  much  more  predictive  of  later  performance  at  different  stages  of 
training.  This  research  also  indicated  that  instructors  found  effectively  addressing  their  Soldiers’ 
needs  by  dividing  their  attention  between  two  subgroups  an  often  impossible  task.  It  also  found 
that  providing  problems  for  observing  Soldiers  to  work  on  and  asking  them  simple,  direct 
questions  were  the  most  common  strategies  instructors  used  to  gauge  their  comprehension  and 
understanding  of  the  ongoing  training  event.  It  also  showed  that  the  ability  alter  or  overlap  the 
sequence  of  training  events  within  broadly  defined  boundaries  was  key  to  91 A  instructors’ 
effectiveness  to  tailor  training  in  a  manner  that  enhanced  student  engagement.  Finally,  this 
research  indicated  the  degree  to  which  facilitation  strategies  used  to  engage  students  using  the 
BRITE  mobile  classroom  trainer  (MCT)  were  effective  depended  upon  the  ability  of  instructors, 
either  individually  or  in  collaboration,  to  engage  a  large  group  of  students  in  active  learning 
using  the  technology,  the  availability  of  preprogrammed  content,  and  the  level  of  comfort  an 
instructor  had  with  operating  and  troubleshooting  the  MCT.  However,  it  also  indicated  that 
lower  performing  and  less  knowledgeable  students  appeared  to  benefit  most  from  the  learning 
environment  created  when  using  the  MCT. 

Based  on  our  findings,  we  provide  recommendations  for  developing  tailored  predictor 
measures  based  on  critical  basic  concepts  and  skills  underlying  course  content,  tailoring  small 
group  training,  and  integrating  BRITE  technologies  within  training  to  enhance  student  learning 
and  engagement. 

Utilization  and  Dissemination  of  Findings: 

The  results  of  this  effort  were  reviewed  with  the  Commander  and  training  directors  in  the 
3-8 1st  Armor  Battalion,  Fort  Benning  GA.  A  written  summary  of  the  overall  findings  and 
recommendations  from  this  presentation  was  also  provided  to  DCG-IMT,  as  requested. 
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Tailored  Training  in  Vehicle  Maintenance  Courses 
Introduction 

A  central  tenet  within  the  Anny  Learning  Concept  2015  (ALC  2015),  according  to  U.S. 
Army  Training  and  Doctrine  Command  (TRADOC)  Pamphlet  525-8-2  (TRADOC,  2011),  and 
Army  Learning  Model  (ALM)  is  the  need  to  transition  to  learner-centric  methods  and  processes 
that  develop  critical  competencies  through  rigorous,  tailored,  outcome-oriented  learning 
experiences.  The  ALM  described  in  the  ALC  2015  also  emphasizes  the  use  of  pretests  and 
training  assessments  to  effectively  tailor  training  to  individual  Soldiers’  needs  as  defined  by  their 
experiences  and  proven  competencies  (see  TRADOC,  2011).  While  not  dependent  on  any 
particular  type  of  technology,  the  ALM  recognizes  the  value  of  institutional  training  programs 
employing  blended  learning  approaches  incorporating  virtual  and  constructive  simulations, 
gaming  technology,  and  other  technology-delivered  instruction  to  deliver  the  types  of 
experiences  needed  to  “. .  .engage  learners  to  think  and  understand  the  relevance  and  context  of 
what  they  learn”  as  specified  in  the  ALC  2015  (TRADOC,  2011,  p.9).  By  emphasizing  the  use 
of  pretests  and  assessments  to  identify  individual  learner  needs  and  to  effectively  tailor  training 
to  meet  those  needs,  the  ALM  has  increased  the  need  to  identify  and  develop  accurate,  effective 
predictive  measures  of  performance,  as  well  as  blended,  learner-centric  tailored  training 
strategies  and  techniques. 

Previous  research  conducted  by  the  U.S.  Army  Research  Institute  (ARI)  Ft.  Benning 
Research  Unit  identified  the  learning  contexts  in  which  tailored  training  most  often  occurred  and 
which  tailored  training  strategies  were  most  commonly  employed  in  current  Anny  courses 
(Dyer,  Wampler,  &  Blankenbeckler,  2011).  The  results  of  this  effort  showed  that  tailored 
training  in  the  Army  is  most  likely  to  occur  in  technical,  functional  courses  where  graduates  must 
be  proficient  in  clearly  defined  skills,  based  on  specified  perfonnance  standards,  upon 
graduation.  This  research  indicated  that  instructors  in  these  courses  often  use  small  groups, 
typically  comprised  of  four  to  five  individuals,  to  more  effectively  tailor  training  to  meet 
individual  students’  needs.  It  also  found  that  one-on-one  instruction  was  still  the  preferred 
method  for  training  in  practical  exercises  (PEs)  (Dyer  et  ah,  2011).  However,  direct  observations 
of  small  groups  in  actual  training  settings,  e.g.,  classrooms  or  hands-on  PEs,  or  of  critical 
training  interactions,  i.e.  instructor-student,  student-student,  and  student-instructor,  needed  to 
identify  the  exact  tailored  training  strategies  and  techniques  being  employed  was  not  possible  in 
this  effort  (see  Dyer  et  ah,  2011). 

An  extensive  review  of  published  tailored  training  research  by  Schaefer  and  Dyer  (2013) 
pointed  out  that  Cohen  (1994)  found  group  interactions  were  impacted  by  both  the  perceived 
status  of  group  members  and  the  nature  of  the  task  or  problem.  In  essence,  the  nature  of  a  task  or 
problem  places  greater  or  lesser  emphasis  on  the  unique  skills  and  experiences  of  individuals 
within  any  group  based  on  their  relevance  to  a  specific  situation.  Concurrently,  the  task  or 
problem  frequently  limits  or  channels  the  type  and  flow  of  interactions  within  the  group  by  its 
imposed  structure.  Therefore,  it’s  easy  to  imagine  how  a  group’s  internal  interactions  could  be 
affected  by  having  a  recognized  leader  or  “expert”  within  it  or  completing  a  task  that  physically 
separates  members  or  portions  of  the  group  at  various  times.  For  example,  in  military  settings, 
it’s  not  uncommon  to  have  situations  where  an  instructor  is  actively  working  with  one  student  on 
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a  problem  or  technical  task  while  the  remaining  students  are  expected  to  follow  along  the  best 
they  can  from  largely  passive  observation  positions.  It’s  common  for  organizations  to  identify 
stronger,  more  skilled  students  early  in  training  in  order  to  have  them  act  as  infonnal  peer 
instructors  assisting  the  instructor  in  advancing  the  group’s  training  through  active  problem¬ 
solving  and  student  led  exercises  or,  at  a  minimum,  keeping  other  students  engaged  in 
constructive,  engaging  activities  while  they  wait  their  turn.  However,  there  has  been  little 
research  focused  on  identifying  the  actual  different  tailored  training  strategies,  e.g.  scaffolding, 
backwards  fading,  or  comprehension  gauging,  employed  in  these  divided  small  group  training 
settings  based  on  interpersonal  interactions  or  how  the  nature  and  frequency  of  these  interactions 
subsequently  affect  student  learning  or  task  performance. 

Efforts  to  identify  more  advanced  students  early  in  training  in  order  to  effect  later  peer- 
to-peer  learning  strategies  and  exercises,  or  enhance  student  engagement  in  learning  activities, 
highlights  a  need  to  develop  or  identify  suitable  predictive  measures.  Previous  tailored  training 
research  conducted  by  ARI  identified  a  number  of  behavioral  dimensions  that  predict  course 
performance  in  professional  military  courses  and  enable  instructors  to  better  distinguish  between 
weak  and  strong  individuals  in  time  to  address  these  individual  differences  during  training.  This 
research  has  shown  that  domain-specific,  prior  military  knowledge  is  the  best,  most  consistent 
predictor  of  later  course  perfonnance  (see  Schaefer,  Blankenbeckler,  &  Lipinski,  2011;  Schaefer, 
Blankenbeckler,  &  Brogdon,  2011)  when  compared  with  other  basic  background  dimensions, 
such  as  the  number  of  deployments  a  Soldier  had  prior  to  training  or  the  duration  of  their  service 
in  the  Army. 

As  Schaefer  and  Dyer  (2013)  point  out  in  their  review  of  the  tailored  training  literature, 
previous  research  (e.g.  Schmidt,  Hunter,  &  Outerbridge,  1986;  Chen  &  Paul,  2003;  Palumbo, 
Miller,  Shalin,  &  Steele- Johnson,  2005)  has  maintained  that  the  relationship  between  experience 
and  job  performance  can  be  direct  or  indirect  depending  upon  opportunities  to  learn  (i.e.  job 
experiences)  and  the  impact  of  other  moderating  variables,  such  as  general  mental  ability  (i.e.  a 
measure  of  the  capacity  one  has  to  learn).  Generally,  one  would  expect  these  moderating 
variables  to  have  less  of  an  impact  if  the  relationship  between  experience  and  job  perfonnance  is 
directly  linked  than  if  it’s  predominately  indirect.  Schaefer  and  Dyer  (2013)  concluded  that  this 
research  has  consistently  shown  that  prior  knowledge  can  frequently  better  predict  perfonnance 
in  a  narrow  domain,  such  as  typify  the  technical  training  found  in  Anny  Advanced  Individual 
Training  (AIT)  programs,  than  general  mental  ability  and  job  experience  alone.  However,  these 
findings  provide  little  practical  guidance  to  Anny  training  developers  and  instructors  on  how 
exactly  to  identify  or  develop  effective  predictive  measures  that  could  be  efficiently  used  in 
actual  training  settings. 

Armored  Vehicle  Maintainer  Training 

A  practical  example  of  the  types  of  military  training  programs  discussed  previously  are 
the  Abrams  tank  (91A1)  and  Bradley  Fighting  Vehicle  (91M)  maintainers’  AIT  courses  executed 
by  the  Ordnance  Training  Detachment,  3-8 1st  Armor  Battalion  (3-8 1st  AR  BN),  at  Fort  Benning, 
GA.  These  courses  are  14  (91A)  and  13  (91M)  weeks  in  length  with  a  maximum  class  size  of  24 


1  91A  and  91M  are  the  military  occupational  specialties  (MOSs)  for  Abrams  and  Bradley  maintainers, 
respectively. 
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and  40  Soldiers,  respectively.  Both  courses  rely  on  small  groups  of  four  to  five  Soldiers  during 
PEs  and  hands-on  training,  which,  according  to  discussions  with  current  training  managers, 
constitutes  about  80%  of  scheduled  course  time. 

Soldiers  are  assigned  to  their  training  groups  based  on  perfonnance  outcomes 
documented  during  the  first  two  to  three  weeks  of  training,  including  physical  fitness  test 
perfonnance,  academic  test  scores,  and  instructors’  subjective  assessments.  Using  these  criteria, 
the  students  detennined  to  be  “strongest”  are  designated  as  excellence  in  maintenance  (EIM) 
Soldiers.  While  separate  EIM  groups  are  normally  created  in  91 A  classes,  significant  effort  is 
made  in  91M  classes  to  balance  high  and  low  performers  across  assigned  training  groups.  In  this 
way,  the  stronger  EIM  Soldiers  can  help  weaker  students  overcome  problems  during  the  91M 
course  and  provide  a  peer  leader  or  coaching  resource  for  the  instructors.  The  EIM  group  within 
each  91 A  class  experiences  an  accelerated  and  more  challenging  training  program,  involving 
additional  vehicle  types  and  more  advanced  tasks  that  are  not  covered  in  the  standard  program  of 
instruction  (POI).  However,  91 A  EIM  students  can  be  called  upon  by  instructors  to  tutor  or 
assist  members  of  the  remaining  groups  during  training. 

Additionally,  the  91M  course  introduced  a  number  of  new  instructional  technologies  in 
2012  under  the  Blended  Rotation  Interactive  Technology  Environment  (BRITE)  initiative.  A 
key  component  of  this  initiative  was  the  use  of  a  mobile  smartboard  for  presenting  training 
materials.  Routinely  referred  to  as  the  “mobile  classroom  trainer”  (MCT),  this  technology 
extends  the  advantages  of  a  classroom  setting  to  other  training  environments,  while  providing 
instructors  with  an  additional  means  for  facilitating  student  learning.  Additionally,  a  portable, 
head  or  structure  mounted  camera  enables  other  Soldiers  to  “see”  what  the  Soldier  being  trained 
sees  or  watch,  from  a  neutral  vantage  point  or  the  instructor’s  perspective,  the  Soldier’s  actions 
during  PEs  or  other  hands-on  activities.  This  capability  enables  an  instructor  to  overcome  the 
physical  limitations  within  the  Bradley  Fighting  Vehicle  (BFV),  which  normally  allow  at  most 
two  Soldiers  within  a  group  of  four  to  actively  participate  in  a  hands-on  training  event  or  a  PE  at 
any  one  time.  The  smartboard/camera  combination,  comprising  the  MCT,  enables  all  or  groups 
of  Soldiers  to  see  the  actions  perfonned  by  the  Soldier  being  trained,  providing  some 
familiarization  and  opportunities  for  vicarious  or  instructor  facilitated  learning  prior  to  their 
rotation.  Digitally  videotaped  student  sessions  can  also  be  saved  for  either  group  or  individual 
after  action  reviews  (AARs)  later  in  training.  Finally,  the  MCT  can  be  used  for  more  traditional 
training  purposes  (e.g.  show  videos,  use  as  a  white  board,  show  slides,  present  PEs)  using 
content  developed  by  the  unit  for  this  purpose. 

Recent  research  relevant  to  examining  the  potential  impact  of  the  BRITE  initiative  on 
learning  and  student  engagement  involved  pairs  of  students  watching  a  tutoring  session  and 
simultaneously  collaborating  to  solve  a  problem  (see  Chi,  2009;  Craig,  Chi,  &  VanLehn,  2009). 
Based  on  Schaefer  and  Dyer’s  (2013)  review,  the  results  of  this  research  showed  that  active 
observing  was  an  effective  learning  process  in  these  situations.  As  described  by  Craig  et  al. 
(2009),  active  observing  reflects  observing  a  demonstration,  training  event,  video,  etc.  in  a  way 
that  facilitates  working  with  or  engaging  the  training  materials  in  a  manner  encouraging  deeper 
cognitive  processing.  Craig  et  al.  pointed  out  that  the  most  effective  means  to  achieve  this 
outcome  is  to  ensure  students  solve  problems  while  observing,  work  in  pairs  rather  than  alone, 
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and  watch  videos  or,  by  inference,  modeled  training  demonstrations  or  events  involving  high- 
ability,  knowledgeable  students. 

Problem  Definition 

The  intent  of  this  research  was  to  address  gaps  identified  in  previous  research  conducted 
on  tailored  training  approaches  and  examine  specific  training  issues  raised  by  the  3-8 1st  AR  BN 
at  Fort  Benning,  GA.  As  described  earlier,  these  armor  vehicle  maintainers’  AIT  courses 
provided  an  excellent  opportunity  to  examine  how  small  groups  function  in  technical  military 
courses  and  the  nature  of  tailored  training  strategies  used  by  instructors  in  these  settings.  In 
addition,  as  these  courses  focus  on  unique  technical  skills  required  for  maintaining  critical 
combat  resources,  most  Soldiers  do  not  possess  a  substantial  amount  of  prior  domain-specific 
knowledge  or  skills  before  reporting  for  training.  Therefore,  prior  military  knowledge  predictors 
that  worked  in  previous  research  using  graduates  of  prerequisite  courses,  such  as  the  research  by 
Schaefer,  Blankenbeckler,  and  Brogdon  (2011),  are  not  appropriate  for  these  training  settings 
and  require  expanding  the  base  of  potential  performance  predictors.  Working  with  3-8 1st  AR  BN 
leaders  and  training  managers,  the  following  objectives  were  identified  for  this  research: 

•  Identify  potential  predictors  of  perfonnance  at  different  stages  of  training  in  the  91 A  and 
91M  AIT  courses  that  will  enable  instructors  to  better  identify  strong  and  weak  Soldiers. 

•  Examine  small  group  processes  in  both  courses  to  identify  the  nature  and  extent  of 
tailored  training,  peer-to-peer  interaction,  and  how  tailoring  varies  with  group 
composition. 

•  Examine  the  effectiveness  and  other  impacts  of  the  BRITE  technologies  (91M  course 
only)  employed  by  the  3-8 1st  AR  BN. 

Method 

This  research  was  completed  in  two  phases.  During  Phase  1,  researchers  assessed  the 
utility  of  demographic  characteristics,  prior  knowledge,  and  cognitive  measures  for  predicting 
later  performance  in  Abrams  tank  and  BFV  maintainers’  training.  Based  upon  training  schedules 
and  class  availability,  this  data,  as  well  as  unit  documented  training  outcomes,  were  collected 
from  five  consecutive  91 A  and  three  consecutive  91M  classes.  In  Phase  2,  researchers  expanded 
this  effort  by  collecting  data  on  instructional  methodologies  and  techniques,  tailored  training 
strategies,  and  student  performance  and  interactions  through  direct  observation  of  scheduled 
training  and  unit  provided  training  summaries  and  records.  Training  was  observed  during  three 
nonconsecutive  one- week  periods,  interspersed  over  the  duration  of  the  course,  beginning  a  week 
after  assignment  of  Soldiers  to  their  training  groups.  Following  the  completion  of  training 
observations  for  each  class,  focus  group  interviews  were  conducted  with  the  participating 
students  and  instructors. 

Multiple  meetings  with  the  Ordnance  Training  Detachment  (OTD),  3-8 1st  AR  BN, 
provided  a  practical  overview  of  91 A  and  91M  training  and  training  challenges,  as  well  as 
several  opportunities  to  informally  observe  hands-on  training  in  small  group  settings  at  different 
points  in  the  courses.  Feedback  and  infonnation  provided  by  OTD  leaders,  instructors,  and 
training  developers  highlighted  critical  graduation  requirements  and  training  priorities,  provided 
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practical  background  information  on  the  most  common  techniques  used  by  instructors  in  small 
group  settings,  and  reviewed  standards  and  procedures  for  course  examinations  and  practical 
evaluations.  Additionally,  these  discussions  were  critical  to  understanding  the  scope  of  the 
BRITE  initiative  and  the  milestones  associated  with  its  planned  rollout. 

It  is  important  to  note  that  the  BRITE  class  identified  for  this  research  effort  was  the  first 
class  where  instructors  had  complete  access  to  the  MCT.  At  this  stage,  the  amount  of  training 
content  on  the  single,  operational  MCT  was  limited  to  a  few  embedded,  basic  automations  and 
schematic  exercises.  Some  instructors  had  also  received  a  basic  familiarization  orientation  on 
the  equipment’s  operation  and  capabilities  prior  to  the  start  of  this  research  and  were  expected  to 
pass  on  this  knowledge  to  other  instructors.  Unit  leaders  encouraged  the  instructors  to  explore 
the  MCT’s  range  of  capabilities  as  they  saw  fit  and  make  extensive  use  of  the  head-mounted 
camera  link  whenever  possible.  The  use  of  the  MCT  was  limited  to  the  91M  test  class  during 
this  research  effort.  There  were  no  other  limitations  imposed  by  unit  leaders  on  the  MCT’s  use 
by  instructors.  However,  it  remains  important  to  note  that  there  was  only  one  operational  MCT 
available  for  use  during  this  research  effort. 

Participants 

A  total  of  164  Soldiers  participated  in  Phase  1  of  this  effort.  As  can  be  seen  in  Table  1, 
the  level  of  participation  during  Phase  2  (n  =  69)  was  limited  to  the  number  of  small  training 
groups  that  could  be  directly  observed  by  qualified  subject  matter  experts  (SMEs)  from  the 
research  team.  In  the  case  of  91 A  classes,  smaller  class  sizes  allowed  each  of  the  resulting  four 
training  groups  of  four  to  five  students  to  be  observed.  In  the  case  of  91M  classes,  it  was  not 
possible  to  directly  observe  each  training  group.  Four  groups  were  selected  for  observation 
based  on  the  number  of  available  qualified  SMEs  and  discussions  with  each  class  lead  instructor 
regarding  the  most  appropriate  groups  to  observe  in  order  to  gain  a  subjectively  accurate  picture 
of  the  full  range  of  instructor  styles  and  student  potential  within  a  typical  class.  Over  the  period 
of  observations,  some  instructors  and  Soldiers  moved  between  groups,  but  efforts  were  made  to 
consistently  observe  the  four  primary  groups  for  all  three  observation  periods.  The  number  of 
Soldiers  in  the  observed  groups  varied  from  three  to  five  at  a  time,  with  four  Soldiers  per  group 
being  the  predominant  composition  (i.e.  75%  of  groups  observed). 

Table  1. 

Number  of  Participants 


Course 

Classes 

Observed 

Groups 

Soldiers 

Instructors 

91A 

Phase  1 

5 

N/A 

81 

N/A 

Phase  2* 

2 

8 

35 

16 

91M 

Phase  1 

3 

N/A 

83 

N/A 

Phase  2* 

2 

8 

34 

8 

*Note:  Observed  groups  are  subsets  of  final  two  classes  participating  in  Phase  1;  regarding  the  91A  instructors 
observed,  eight  were  hull  instructors  and  eight  were  turret  instructors. 
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At  the  beginning  of  each  participating  class,  the  training  units  provided  the  research  team 
with  basic  demographic  data  on  all  participating  Soldiers.  This  data  is  summarized  in  Table  2 
and  indicated  there  were  no  statistically  significant  differences  in  the  general  make-up  of  the 
classes  selected  for  this  effort.  Table  2  identifies  non-nonnally  distributed  variables  (i.e.,  rank 
and  education)  by  the  most  frequently  occurring  value  (mode).  General  Technical  (GT)  scores 
and  ages  are  represented  by  their  mean  values.  Demographic  information  was  not  provided  for 
Abrams  Course  91A04A.  In  the  judgment  of  the  instructors  assigned  to  these  classes,  the  rank 
and  age  of  the  Soldiers  participating  in  this  research  were  typical  of  past  Abrams  and  Bradley 
courses.  Data  for  all  participating  Abrams  and  Bradley  Soldiers  were  compared  to  archival  data 
from  past  courses  in  terms  of  GT  Scores  and  Go  Percent  (defined  as  the  total  number  of  hands- 
on  evaluations  on  which  a  ‘Go’  was  achieved,  divided  by  the  number  of  total  evaluations 
conducted  on  a  given  Soldier).  A  similar  pattern  emerged  for  both  the  Abrams  and  Bradley 
courses  in  that,  while  GT  scores  were  similar  in  the  participating  and  prior  courses,  the 
percentage  of  “Go”  ratings  was  higher  in  the  participating  courses.  However,  when  the  data  is 
examined  in  greater  detail,  it  appears  that  this  difference  was  more  a  function  of  smaller  standard 
deviations  than  a  real  appreciable  difference  in  perfonnance  (see  Table  E-l,  Appendix  E). 

Table  2. 

Soldier  Demographics 


Course* 

Class 

Rank 

(Mode) 

Age 

(Mean) 

GT  Score 
(Mean) 

Education** 

(Mode) 

91A 

04A 

N/A 

N/A 

N/A 

N/A 

05A 

PVT 

23 

107 

HSG 

06A 

PVT 

22 

98 

HSG 

07A 

PVT 

22 

110 

HSG 

08A 

PVT 

22 

103 

HSG 

91M 

04M 

PVT 

23 

103 

HSG 

05  M 

PVT 

21 

102 

HSG 

06M 

PFC 

21 

106 

HSG 

*Note:  The  shaded  classes  participated  in  both  Phase  1  and  Phase  2.  The  remaining  classes  only  participated  in 
Phase  1. 

**Note:  HSG=high  school  graduate. 

Data  Collection  Instruments 

Predictor  measures.  As  discussed  earlier,  a  review  of  published  literature  was 
conducted  to  provide  a  foundation  for  this  research  and  the  development  of  all  data  collection 
instruments.  Specific  attention  was  given  to  previous  research  on  armor  vehicle  training  (e.g. 
Drucker  &  O’Brien,  1982;  Roth,  Cherry,  &  Strasel,  1988),  predictive  performance  tests  (e.g. 
Schaefer,  Blankenbeckler,  &  Lipinski,  2011;  Schaefer,  Blankenbeckler,  &  Brogdon,  2011; 
Heuckeroth  &  Smith,  1990),  and  conducting  training  observations  in  field  settings  (Leibrecht, 
Goodwin,  Wampler,  &  Dyer,  2007).  Based  on  this  review  and  discussions  with  unit  leaders  and 
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SMEs,  it  became  readily  apparent  that  our  most  viable  options  for  developing  additional 
predictive  measures  would  need  to  focus  on  cognitive  and  general  domain  related  skills  beyond 
the  unit’s  current  reliance  on  GT  scores"  and  initial  test  results. 

Reviewing  information  and  feedback  provided  by  unit  SMEs,  the  established  POI, 
current  training  support  packages  (TSPs),  and  our  initial,  informal  training  observations,  it 
became  apparent  that  a  few  basic  skills  seemed  centrally  prevalent  throughout  the  training. 

Based  on  the  TSPs’  and  instructors’  consistent  emphasis  on  the  ability  of  Soldiers  to  effectively 
execute  complex  checklists  integrating  infonnation  from  multiple  technical  manuals  and  system 
(i.e.  electronic  and  mechanical)  schematics,  a  few  basic  abilities  seemed  to  consistently 
differentiate  stronger  students  from  weaker  ones  early  in  training:  (1)  able  to  follow  detailed 
instructions  that  set  conditions  on  required  actions  or  decision  options  (i.e.  integrative  processes), 
(2)  able  to  accurately  remember  and  reference  blocks  of  infonnation  or  visual  images  from 
multiple  manuals  (i.e.  working,  visual  memory),  and  (3)  able  to  correctly  interpret  and  follow 
schematic  diagrams  (i.e.  spatial  scanning). 

Reviewing  established,  reliable  cognitive  tests  that  paralleled  these  requirements  and  that 
could  be  easily  administered  within  the  time  allotted  for  Phase  1  assessments,  the  research  team 
identified  three  standardized  measures  available  through  the  Education  Testing  Service  (ETS),  as 
meeting  our  needs  for  this  effort.  The  team  secured  an  agreement  from  ETS  to  use  the  following 
tests  from  their  1976  kit  (see  Ekstrom,  French,  Harman,  &  Dennan,  1976)  for  this  research 
effort:2 3 

•  “Following  Directions.”  Soldiers  were  given  a  complex  set  of  instructions,  then 
asked  to  identify  the  points  in  a  matrix  of  letters  in  response  to  10  questions.  Soldiers 
were  given  7  minutes  to  complete  the  measure,  [integrative  processes] 

•  “Building  Memory.”  Soldiers  were  asked  to  identify  the  location  of  12  different 
buildings  on  a  map  without  access  to  the  original  map.  Soldiers  were  given  4  minutes 
to  select  the  correct  location  for  each  of  12  buildings  from  five  options  reflected  on  a 
copy  of  a  street  map  without  any  buildings,  after  being  given  4  minutes  to  study  the 
original  map  with  all  12  buildings  in  place,  [visual  memory] 

•  “Choosing  a  Path.”  Soldiers  were  asked  to  identify  which  of  a  network  of  lines 
(similar  to  that  found  in  electronic  schematics)  fulfilled  the  specified  requirements  to 
start  and  finish  in  the  same  block  while  passing  through  a  circle  at  the  top  of  the 
drawing  and  following  a  set  of  imposed  movement  restrictions.  Soldiers  were  given  7 
minutes  to  complete  16  items,  [spatial  scanning] 


2  The  GT  score  is  a  composite  score  derived  from  the  sum  of  Word  Knowledge  and  Paragraph 
Comprehension  (VE)  and  Arithmetic  Reasoning  (AR)  sections  of  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB).  In  order  to  enter  91A  or  91M  training,  Soldiers  must  have  a  minimum  mechanical  maintenance  (MM) 
score  of  99  or  a  minimum  MM  of  88  combined  with  a  minimum  GT  score  of  92. 

3  While  ETS  allowed  the  use  of  these  tests  for  this  research  effort,  copies  of  the  tests  cannot  be  provided  in 
this  report.  Any  requests  for  copies  or  use  of  these  or  any  ETS  tests  must  be  addressed  to  ETS  through  their  offices 
in  Princeton,  NJ. 
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As  discussed  earlier,  Schaefer  and  Dyer  (2013)  found  that  published  research  consistently 
indicated  prior  knowledge  could  frequently  better  predict  perfonnance  in  a  narrow  domain,  such 
as  found  in  the  annor  vehicle  maintainers’  technical  training,  than  general  mental  ability  and  job 
experience  alone.  Given  unit  feedback  indicating  prior  experience  using  digital  technologies, 
including  personal  computers  and  laptops,  and  conducting  mechanical  vehicle  servicing  and 
repairs  were  most  relevant  to  Soldiers  excelling  in  the  technical  skills  emphasized  during  armor 
vehicle  training,  a  general  background  questionnaire  was  created  to  measure  the  degree  to  which 
Soldiers  entered  training  with  these  experiences.  Additionally,  course  instructors  emphasized 
that  having  prior  experience  and  knowledge  of  basic  electrical  processes  and  schematics  enabled 
Soldiers  to  excel  in  the  early  portion  of  training.  Therefore,  the  questionnaire  included  three 
items  developed  by  an  experienced  unit  instructor  that  tested  incoming  Soldiers’  prior  knowledge 
of  basic  electrical  circuits  and  symbols.  A  copy  of  this  questionnaire  is  provided  in  Appendix  A. 

Training  observations.  Previous  research  conducted  by  Liebrecht,  Goodwin,  Wampler, 
and  Dyer  (2007),  Dyer,  Singh,  and  Clark  (2005),  and  Sanders  (2001)  showed  that  focused 
training  interactions  could  be  reliably  recorded  in  real-time  using  trained  SMEs.  Additionally, 
data  gained  during  direct  observations  of  training  interactions  reduced  the  potential  for  over 
relying  on  self-reported  subjective  assessments  gathered  from  questionnaires  and  interviews. 

The  instruments  and  strategies  employed  in  this  earlier  research  provided  a  sound  foundation  for 
developing  similar  instruments  for  recording  data  on  the  various  types  of  interactions  occurring 
during  training. 

Based  on  the  objectives  of  this  effort,  it  was  essential  to  document  the  type  and  frequency 
of  training  related  interactions  occurring  between  instructors,  Soldiers,  and  peers  in  various 
training  settings  in  order  to  identify  the  nature  and  extent  of  tailored  training,  peer-to-peer 
interaction,  and  variations  in  tailored  training  strategies  used  by  the  instructors.  The  observation 
instrument  developed  for  this  effort  was  comprised  of  four  parts  and  is  provided  in  Appendix  B. 
While  Part  I  gathered  infonnation  about  the  initial  training  setting  and  purpose  at  the  start  of  the 
day’s  observations,  Part  II  provided  detailed  information  about  instructors’  training  styles  and 
the  training  interactions  between  instructors  and  Soldiers  during  the  observation  periods.  Part  III 
captured  data  about  the  nature  of  activities  and  interactions  occurring  before  and  after  observed 
practical  evaluations.  Finally,  Part  IV  provided  the  SME  observers  an  opportunity  to  assess  the 
entire  day’s  training  and  to  summarize  end-of-day  conclusions  based  on  their  observations. 

Based  on  preliminary  observations  of  training  and  discussions  with  instructors  and 
training  managers,  it  became  apparent  that  the  nature  of  instructor  styles  and  degree  of 
interactions  differed  significantly  depending  upon  the  group  size.  During  the  course  of  training, 
the  size  of  the  group  being  instructed  varied  from  the  entire  class  to  the  defined  small  groups  to 
multiple  groups  (two  or  more)  throughout  any  given  day.  Thus,  Part  II  of  the  observation 
instrument  allowed  observers  to  group  their  observations  based  on  changes  from  one  group  size 
to  another.  Since  previous  discussions  with  unit  training  managers  indicated  about  80%  of  all 
training  was  designed  to  be  executed  in  designated  small  training  groups  of  four  to  five  Soldiers, 
it  was  decided  that  individual  observers  would  be  assigned  to  collect  data  on  only  one  of  the 
defined  small  groups,  regardless  of  the  group  size.  These  measures  also  supported  later  analyses 
comparing  changes  in  instruction  styles  (see  Table  3)  and  interaction  patterns  across  different 
training  group  settings,  as  well  as  providing  insights  into  the  degree  to  which  efforts  to  move  to 
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more  learner-centric  instructional  styles  from  more  traditional,  instructor-centered  or  platfonn 
instructional  practices,  in  accordance  with  the  ALM,  were  impacting  instructional  strategies. 

Table  3. 

Instruction  Codes 


Codes 

Instructional  Styles 

D1 

Demonstration 

D2 

Guided  Demonstration 

GD 

Guided  Discussion 

RC 

Review/reinforce  Content 

LI 

Lecture 

ID 

Informal  Discussion 

PS 

Problem  Solving 

Ot 

Other 

Following  methods  validated  in  previous  research  by  Liebrecht,  et  al.  (2007),  observers 
recorded  the  number  of  times  they  observed  the  instructor  and  Soldiers  in  their  assigned  group 
engage  in  each  of  the  interaction  behaviors  identified  in  Table  4. 4 

Table  4. 

Interaction  Codes 


Trainer/Instructor  Interaction  Codes: 

Student  Interaction  Codes 

A  -  Asks  question 

A  -  Asks  question  of  Instructor 

P  -  Provides  feedback  on  action/performance 

Q  -  Answers  or  responds  to  a  question  from  Instructor 

R  -  Restates  or  refocuses  the  question/problem 

L  -  Takes  leadership  role  or  initiative  (w/o  being  directed) 

S  -  Directly  answers  the  student’s  question 

O  -  Offers/provides  help  or  support  to  peer(s) 

E  -  Provides  additional  examples 

A_s  -  Asks  question  of  a  peer 

C  -  Reviews  previous/related  content 

Q_s  -  Answers  or  responds  to  a  question  from  a  peer 

L  -  Designates  a  task  or  group  leader 

H  -  Accepts  help/support  from  peer(s) 

T  -  Directs  a  task 

T  -  Completes/attempts  a  directed  task 

Ot  -  Other 

Ot  -  Other 

Instructors  also  indicated  during  initial  discussions  with  research  team  members  that  they 
usually  worked  directly  with  one  or  two  students  at  a  time  in  small  group  settings  due  to  the 
physical  restrictions  of  the  equipment  or  the  demands  of  the  task  being  trained.  Therefore,  a 
variation  of  the  original  Part  II  form  was  developed,  Part  Ha,  to  gather  detailed  data  about  the 
instructional  styles  used  and  interactions  occurring  in  this  unique  training  setting.  This  setting 
required  instructors  to  divide  their  attention  between  the  student(s)  directly  engaged  in  the 
learning  activity  and  the  remainder  of  the  group  who  observed  the  training,  as  best  they  could, 


4  Due  to  positioning  of  the  observers,  it  was  easier  to  determine  when  a  given  student  asked  a  question  or 
responded  to  a  question  than  it  was  to  determine  if  the  question  had  been  addressed  to  the  instructor  (Student 
Interaction  Code  A)  or  a  peer  (Student  Interaction  Code  A  s).  A  similar  problem  arose  in  distinguishing  responses 
to  instructor  questions  (Student  Interaction  Code  Q)  from  responses  to  peer  questions  (Student  Interaction  Code 
Q_s).  Therefore,  more  global  categories  of  ‘Asks  questions’  and  ‘Answers  or  responds  to  question’  were  used.  (See 
Tables  E-10,  E-13,  and  E-16  in  Appendix  E  for  examples.) 
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while  waiting  for  their  turn.  Thus,  observers  needed  to  simultaneously  attend  to  the  instructor 
and  student(s)  completing  the  hands-on  training  event  and  the  level  of  student  engagement 
occurring  outside  of  the  instructor  and  student(s)  comprising  the  instructional  focal  group. 

Due  to  the  normally  high  level  of  instructor-student  interaction  in  the  one-on-one  or  one- 
on-two  instructional  group  and  the  physical  impossibility  of  placing  an  observer  in  a  position  to 
accurately  document  the  nature  of  the  interactions  occurring  within  both  subgroups  without 
disrupting  training,  observers  were  directed  to  focus  on  changes  in  the  instructional  strategies 
used  by  the  instructor  with  the  focal  training  student(s)  and  training  related  interactions  among 
the  observing  students.  Illustrations  of  the  typical  physical  configurations  of  equipment  and 
personnel  during  the  training  observations  are  provided  in  Appendix  C. 

Similar  to  what  is  found  in  many  other  military  training  settings,  initial  observations 
indicated  that  Soldiers  engaged  in  a  great  deal  of  social  interactions  during  “dead  time”  that  were 
unrelated  to  training  activities. 5  Therefore,  it  was  determined  that  data  collection  during  the 
training  observations  would  focus  only  on  interactions  clearly  related  to  training  content  and 
activities.  This  allowed  us  to  also  focus  our  observations  on  how  training  was  being  tailored  to 
different  conditions  and  student  needs,  as  well  as  key  training  outcomes  of  interest  to  the  unit. 

As  described  earlier,  Part  III  of  the  observers’  package  provided  a  means  for  collecting  data  on 
instructor  roles  (listed  in  Table  5)  and  the  frequency  of  student  peer  coaching  or  instruction  (e.g., 
one-on-one,  small  group  (3-5  Soldiers),  etc.)  interactions  occurring  before  and  after  the  practical 
evaluations  (see  Appendix  B). 

Table  5. 

Trainer/Instructor  Pre-  and  Post  Evaluation  Role(s) 


Code 

Trainer/Instructor  Roles 

D1 

Demonstration 

D2 

Guided  Demonstration 

GD 

Guided  Discussion 

RC 

Review/reinforce  Content 

LI 

Lecture 

ID 

Informal  Discussion 

PS 

Problem  Solving 

Ot 

Other 

This  data  also  provided  insights  into  non-directed  student-led  and  peer-to-peer 
interactions  aimed  at  ensuring  group  and  class  members  were  prepared  for  pending  evaluations. 
It  also  provided  a  means  for  documenting  unstructured,  student  generated  or  instructor  initiated 
AARs  following  the  completion  of  evaluations  throughout  the  day. 

Finally,  Part  IV  of  the  observation  fonn  provided  a  means  for  capturing  the  SMEs’ 
overall  impressions  of  the  training  interactions  they  observed  throughout  the  day.  This  was 


5  “Dead  time”  is  a  colloquialism  referring  to  periods  of  inactivity  when  individuals  are  left  to  their  own 
discretion  while  waiting  for  their  turn  in  an  activity  or  for  a  change  in  events  requiring  their  involvement. 
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intended  to  provide  an  ongoing,  general  assessment  of  training  outcomes  central  to  our 
objectives.  Key  among  the  end-of-day  assessments  made  by  the  SMEs  was  to  rate  the  relative 
frequency  they  observed  different  tailored  training  strategies,  described  in  Table  6,  being 
employed  by  instructors  during  the  training  day  (see  Appendix  B). 

Table  6. 

Tailored  Training  Strategies 


Strategy 

Description 

Primary 

Reference(s) 

Scaffolding 

Instructor  enables  the  student  to  master  a  task  or  concept 
that  the  student  is  initially  unable  to  grasp  on  his/her  own 
by  temporarily  modeling  or  providing  prompts,  cues,  and 
feedback  on  those  skills  or  steps  that  are  currently  beyond 
the  student’s  demonstrated  capability.  Once  the  student 
begins  to  show  he/she  can  accomplish  the  steps  or  task, 
the  instructor  withdraws  help  (often  referred  to  as 
“fading”  or  removing  the  scaffolding)  to  allow  the 
student  to  proceed  on  his/her  own. 

VanLehn  (2011) 

Backwards 

Fading 

Instructor  provides  a  complete  demonstration  of  the  task 
or  procedure,  followed  by  a  progressive  reduction  of 
instructor  guidance  and  an  increasingly  autonomous  role 
by  the  student  in  subsequent  repetitions  of  the  task. 

Renkl,  Atkinson, 
Maier,  &  Staley 
(2002) 

Didactic  / 
Lecture 

Instructor  provides  information  with  little  to  no 
opportunity  for  student/instructor  interaction  or 
discussion  beyond  the  clarification  of  presented  facts  or 
points;  student  largely  passive. 

Chi  &  Roy  (2010) 

Comprehension 

Gauging 

Instructor  confirms  students  are  attending  to  and 
following  the  presented  content;  may  or  may  not  involve 
a  brief  knowledge  check  of  recent  content. 

Chi,  Siler,  Jeong, 
Yamauchi,  & 
Hausmann  (2001); 
Chi  (2009) 

Simple 

(Yes/No) 

Simple  and  direct  assessment  of  or  reaction  to  the 
accuracy  of  a  student’s  answer,  explanation,  statement, 
etc.,  with  no  further  elaboration. 

Graesser  &  Person 
(1994) 

Other 

(Open  ended  category  to  provide  SMEs  an  opportunity  to 
identify  other  tailored  training  strategies  they  saw 
employed  during  their  observations) 

Frequency  ratings  were  based  on  a  four-point  scale  ranging  from  seldom/rarely  (1)  to 
regularly  (3)  observed,  with  an  additional  rating  point  for  “not  observed”  (4)  (see  Appendix  B). 

During  Phase  2  of  this  research,  three  one-week  periods  of  training  observations  were 
completed  during  each  of  four  identified  classes,  i.e.  the  latter  two  classes  for  each  course  (i.e. 
91 A  and  91M)  participating  in  Phase  I.  Researchers  worked  with  unit  leaders  and  SMEs  to 
identify  three  one- week  periods  of  training  that  would  provide  the  broadest  and  most  equivalent 
sampling  of  critical  skills  training  across  the  identified  classes.  Based  on  discussions  with  unit 
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leaders  and  training  developers,  each  of  the  three  selected  observation  periods  covered  generally 
equivalent  blocks  of  training,  in  terms  of  training  emphasis  and  priority,  task  complexity,  and 
resource  demands.  Additionally,  each  of  the  practical  evaluations  covering  material  from  the 
selected  training  periods  were  observed,  even  if  they  occurred  on  a  day  following  the  scheduled 
observation  periods.  In  the  case  of  91M  training,  the  first  class  observed  acted  as  a  control, 
while  the  second  provided  a  setting  for  observing  and  assessing  the  impact  on  training  of 
employing  BRITE  technologies.  Observations  were  delayed  by  one  week  after  the  start  of  the 
course  to  allow  the  groups  and  instructors  a  chance  to  become  familiar  with  each  other. 

Table  7  depicts  the  final  training  observation  schedule.  The  lengthy  period  not  observed 
between  the  second  and  third  observations  for  the  91 A  classes  was  needed  to  observe  the  two 
different  phases  of  the  course,  hull  and  turret  training,  which  were  conducted  by  different  groups 
of  instructors.  All  observations  were  completed  10  days  before  the  planned  graduation  date. 

Table  7. 

Training  Observation  Schedule 


Course 

1st  Observation 

Not  Observed 

2nd  Observation 

Not  Observed 

3rd  Observation 

91A  #1 

1  wk 

6  wks 

91 A  #2 

1  wk 

1  wk 

1  wk 

6  wks 

1  wk 

91M  #1 

2  wks 

1  wk 

91M#2 

1  wk 

1  wk 

Focus  group  interviews.  Protocols  were  developed  for  separate  focus  group  interviews 
with  Soldiers  and  instructors  following  the  completion  of  training  observations  (at  the  end  of 
Phase  2).  Given  the  goals  of  this  effort,  these  interviews  were  designed  to  supplement  data 
collected  through  the  training  observations  by  focusing  on  the  effectiveness  of  training, 
identifying  various  techniques  used  to  tailor  training  to  individual  Soldier’s  needs,  gaining 
insights  into  the  degree  to  which  the  unit’s  efforts  to  fulfill  the  vision  described  in  the  ALM  were 
successful,  and  gauging  reactions  to  the  employment  of  BRITE  technologies  during  training. 

The  research  team  recognized  that,  based  on  previous  field  research  experiences,  interviewers 
might  have  to  select  which  questions  to  ask  during  the  course  of  the  discussions  based  on 
available  time  (no  more  than  1  hour  for  each  interview  session)  and  level  of  discussion. 
Therefore,  the  questions  were  listed  in  order  of  priority  with  critical  questions,  essential  for 
gathering  data  needed  for  the  planned  analyses,  further  highlighted  in  bold  font.  Copies  of  the 
complete  interview  protocols  are  provided  in  Appendix  D. 

Soldier  focus  group  interviews.  The  Soldier  interviews  sampled  their  reactions  to  the 
training  and  instruction  they  received,  gathered  feedback  on  the  course  content  and  exercises, 
and,  if  in  the  91M  class  with  access  to  the  BRITE  technology,  sampled  reactions  to  the 
technology  and  how  it  was  employed  during  the  course.  Additionally,  Soldiers  were  provided  an 
opportunity  to  share  their  ideas  regarding  the  course  in  general  and  applications  of  technology 
specifically.  Accordingly,  the  interview  protocol  was  divided  into  four  sections:  (1)  Small 
Group  Experience,  (2)  Course  Content,  (3)  BRITE  Technology,  and  (4)  Recommendations. 
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Interviews  were  conducted  in  the  same  groups  of  three  to  five  Soldiers  in  which  Soldiers 
were  assigned  for  training.  The  assigned  observer,  who  was  already  familiar  with  the  training 
the  group  received,  the  nature  of  informal  interactions  within  the  group,  and  the  Soldiers  within 
the  group,  conducted  the  interview  for  each  training  group.  These  Soldier  focus  group 
interviews  were  conducted  at  the  end  of  the  third  observation  period  with  each  class. 

Trainer/instructor  focus  group  interviews.  As  described  earlier,  the  focus  group 
interviews  with  instructors  were  designed  to  gather  additional  insights  on  the  frequency  and 
impact  of  tailored  training  strategies  employed  during  the  just  completed  classes.  Information 
was  also  collected  on  the  instructors’  views  about  the  designation  of  EIM  students  and,  if 
applicable,  the  use  of  BRITE  technologies  and  their  respective  impacts  on  Soldier  engagement 
and  performance.  Accordingly,  the  interview  protocol  was  divided  into  four  sections:  (1)  Small 
Group  Processes,  (2)  Tailored  Training,  (3)  BRITE  Technology,  and  (4)  EIM  Group. 

Instructors  were  interviewed  in  one  of  three  one-hour  sessions  for  each  of  the  two 
observed  classes  for  a  total  of  six  interview  sessions.  Four  instructors  were  interviewed  at  the 
end  of  the  third  observation  period  for  each  of  the  two  91M  classes.  Taking  into  account  the  fact 
that  instructors  focusing  on  Abrams  hull  maintenance  completed  their  training  by  the  end  of  our 
second  observation  period  and  did  not  conduct  any  training  during  the  remainder  of  the  course, 
two  separate  interview  sessions  were  conducted  for  each  91 A  class.  The  four  “hull”  instructors 
were  interviewed  following  the  second  observation  period  of  each  class  and  the  four  “turret” 
instructors  were  interviewed  after  the  third  observation  periods. 


Results 


Analytic  Approach 

Quantitative  data  provided  by  the  unit  included  basic  demographic  infonnation 
maintained  in  their  training  records,  documented  test  and  evaluation  results,  and  final  course 
dispositions,  i.e.  graduate,  recycle,  or  restart.  Additional  data  regarding  the  amount  of  relevant 
general  mechanical  and  electrical  knowledge,  skills,  and  experiences  they  had  upon  entering  AIT 
was  provided  by  the  participating  Soldiers  in  response  to  the  background  questionnaire  (see 
Appendix  A).  This  data  was  further  augmented  by  the  results  from  the  standardized  ETS  tests 
described  earlier,  as  well  as  data  gathered  during  the  training  observations  (see  Appendix  B). 

All  quantitative  data  were  entered  in  an  interface  designed  to  streamline  the  data  entry 
and  to  catch  common  data  entry  errors,  such  as  out  of  range  values  due  to  typos,  inadvertent 
transpositions,  etc.  The  completed  data  entries  were  reviewed  by  two  members  of  the  research 
team  and  then  transferred  to  the  IBM  SPSS  Statistics  program  (v  19;  2010)  for  analyses. 

Separate  databases  appropriately  reflecting  systematic  differences  in  the  quantitative  data  from 
the  predictor  tests  and  training  observations  were  created.  In  SPSS,  the  data  were  further 
checked  for  outliers  and  other  types  of  anomalous  responding  before  the  planned  analyses  were 
perfonned.  Once  all  data  entries  were  verified  and  a  few  entry  inconsistencies  resolved,  basic 
descriptive  statistics  were  calculated  using  the  data  provided  by  the  units  (see  Table  2)  and  the 
participants’  responses  from  the  background  questionnaire. 
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Data  Screening  and  Scale  Constructions 

All  variables  were  examined  both  descriptively  and  graphically.  When  a  decision  was 
made  to  exclude  a  variable  from  further  analysis,  a  reason  for  that  exclusion  was  given.  If  no 
individual  item  level  problems  were  found,  Cronbach’s  alphas  were  computed  to  assess  scale 
reliability.  Unless  removing  an  item  resulted  in  an  improvement  in  Cronbach’s  alpha  by  0.10  or 
more  (e.g.,  the  scales  Cronbach’s  alpha  would  increase  from  .80  to  .90),  the  item  was  not 
removed.  Unless  otherwise  stated,  all  items  within  a  given  scale  were  retained. 

Background  questionnaire.  This  instrument  elicited  20  potential  responses  via  8 
questions.  An  item-level  analysis  quickly  revealed  that  questions  asking  respondents  to  indicate 
how  recently  they  had  engaged  in  the  identified  training-relevant  activities  (i.e.,  maintained  a 
vehicle)  reduced  the  Cronbach’s  alpha  to  unacceptable  levels.  Therefore,  all  such  questions  were 
excluded.  This  reduced  the  number  of  data  points  from  20  to  16,  but  yielded  a  robust 
Cronbach’s  alpha  of  .92  (see  Table  E-2,  Appendix  E). 

No  item-level  problems  emerged  during  the  analysis  of  the  three  questions  assessing 
Solders’  prior  knowledge  of  basic  electrical  processes  and  schematics.  The  overall  Cronbach’s 
alpha  (.86)  would  not  have  been  improved  by  removing  any  items  within  these  questions. 
Therefore,  all  items  were  retained.  (See  Table  E-3,  Appendix  E) 

Predictor  Findings 

The  first  objective  of  this  research  was  to  identify  potential  predictors  of  perfonnance  at 
different  stages  of  training  in  the  91 A  and  91M  AIT  courses  to  enable  instructors  to  better 
identify  stronger  and  weaker  students.  However,  it  quickly  became  apparent  that  the 
perfonnance  criterion  (i.e.  Go/No  Go  on  various  test  events)  was  functioning  similarly  to  single 
test  items.  That  is,  there  was  insufficient  variance  on  the  stand-alone  test  events  to  enable  robust 
conelations  with  the  predictor  measures.  Therefore,  a  more  global  measure  of  performance  was 
calculated  and  used  in  this  analysis.  For  each  Soldier,  a  summary  ‘Go  Percent’  statistic  was 
computed  by  dividing  the  total  number  of  ‘Go’  ratings  achieved  by  the  total  number  of  test 
events.  For  example,  if  Soldier  X  achieved  30  ‘Go’s  out  of  50  test  events,  the  Soldier  would 
have  a  Go  Percent  of  60. 

Three  different  regression  models  were  computed:  one  for  Abrams  91 A  and  two  for  the 
Bradley  91M  AIT  courses.  The  91 A  model  was  based  on  Soldier  data  from  5  classes  (see  Table 
2  for  details).  The  two  Bradley  regression  models  were  based  on  2  classes  (04M  and  05M, 
acting  as  Control  classes  reflecting  established  training  conditions)  and  1  class  (06M,  acting  as  a 
Test  class),  respectively.  The  computation  of  separate  regression  Bradley  models  was 
necessitated  by  the  implementation  of  the  BRITE  technology  in  the  06M  class. 

Abrams  regression  model.  Upon  inspecting  the  correlation  matrix  (see  Table  E-4, 
Appendix  E)  for  the  six  predictor  and  one  criterion  variables,  three  things  became  apparent. 

First,  the  only  predictor  statistically  related  to  performance  was  the  prior  knowledge  measure  (r 
=  22,  p  <  .05).  Second,  the  prior  knowledge  measure  was  more  correlated  with  GT  scores  and 
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the  Experience  Index  than  the  three  ETS  measures.  This  also  held  for  the  remaining  two 
regression  models.  Third,  the  pattern  among  Go  Percent,  GT  Score,  Experience  Index,  and  Prior 
Knowledge  Index  replicates  a  well-known  performance  model  developed  by  Schmidt,  Hunter, 
and  Outerbridge  (1986),  repeatedly  supported  in  other  Anny  course  contexts  (Schaefer, 
Blankenbeckler,  &  Lipinski,  2011).  Figure  1  illustrates  the  comparison  of  results  from  the 
original  work  by  Schmidt  et  al.  and  that  from  our  analysis  of  Abrams  training.6 


Schmidt,  Hunter,  &  Outerbridge  (1986)  Abrams 


Figure  1.  Comparison  with  Schmidt,  Hunter,  and  Outerbridge  (1986)  data  (/V=l  ,474).  {Note*  p 
<  .05) 


Before  proceeding,  a  few  comments  comparing  the  left  and  side  panels  of  Figure  1  are  in 
order.  In  general,  the  correlations  are  much  higher  in  Schmidt  et  al.’s  research  than  we  found  for 
Abrams  training.  There  are  at  least  three  reasons  for  this.  First,  Schmidt  et  al.’s  research  is  (as  is 
noted  below  the  figure)  based  upon  almost  1500  individuals,  while  our  results  are  based  on  data 
collected  from  less  than  200  Soldiers.  The  remaining  two  reasons  revolve  around  the 
relationship  between  prior  knowledge  and  the  criterion.  Namely,  the  prior  knowledge  measure 
used  by  Schmidt  et  al.  involved  generating  a  large  number  of  items  and  empirically  down- 
selecting  so  that  only  the  most  predictive  items  were  retained.  This  requires  significant  resources 
which  were  not  available  for  this  research.  Third,  the  criterion  in  our  research  was  dichotomous 
in  nature  (Go/No  Go)  which,  through  restriction  of  range,  results  in  attenuated  correlations. 

Since  only  one  variable  (prior  knowledge)  significantly  predicted  the  performance  criterion,  the 
resulting  regression  model  consisted  of  a  simple  correlation. 


6  Given  that  the  Prior  Knowledge  measure  was  more  correlated  with  GT  Scores  and  Experience  Index  than 
the  ETS  tests  for  all  three  regression  models,  the  discussion  of  variables  in  the  remaining  regression  models  is 
confined  to  the  four  variables  represented  in  the  right  hand  panel  of  Figure  1.  This  can  be  further  justified  on  the 
grounds  that  GT  Score  is  arguably  a  proxy  for  general  mental  ability  (Jensen,  1998)  and  that  the  predictive  power  of 
GMA  often  swamps  that  of  specific  (i.e.,  more  narrow)  tests  (Thorndike,  1985). 
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Bradley  regression  models.  Examination  of  the  correlation  matrix  for  the  two  Bradley 
Control  classes  (see  Table  E-5,  Appendix  E)  echoed  the  trends  found  by  Schmidt  et  al.  and  our 
previous  analysis  of  Abrams  training.  For  the  most  part,  experience  and  general  mental  ability 
(as  measured  by  GT  score)  impacted  perfonnance  indirectly  via  their  relationship  with  prior 
knowledge.  Once  again,  prior  knowledge  was  the  most  direct,  powerful  predictor  of 
perfonnance.7  However,  the  conelation  matrix  for  the  Bradley  BRITE  course  (see  Table  E-6, 
Appendix  E)  looked  markedly  different. 

Figure  2  illustrates  the  comparison  of  our  results  from  the  Bradley  Control  and  BRITE 
classes.  The  most  obvious  difference  between  the  datasets  is  that  the  conelations  in  the  BRITE 
condition  are  noticeably  smaller  and,  in  the  case  of  experience  with  performance,  even  negative. 
In  essence,  the  impact  of  salient  individual  differences  upon  perfonnance  was  lessened  in  the 
case  of  prior  knowledge  and  general  mental  ability  or  even  to  some  extent  reversed  in  the  case 
of  experience.  This  suggests  that  individuals  with  less  experience,  prior  knowledge,  and  general 
mental  ability  were  somehow  benefitting  more  from  the  use  of  the  BRITE  technologies — a 
point  which  will  be  examined  further  in  our  assessment  of  the  impact  of  BRITE  technology. 

The  main  conclusion  for  now,  however,  is  that  prior  knowledge  is  the  most  proximate,  and 
therefore  most  useful,  predictor  of  course  perfonnance. 


Bradley  Contr  ol  Bradley  BRITE 


Figure  2.  Comparison  of  Bradley  Control  and  Bradley  BRITE  course  data.  {Note*  p  <  .05) 


Training  Observations  Findings 

The  training  observation  methodology  we  employed,  as  described  earlier  in  this  report, 
yielded  a  wealth  of  data.  As  can  be  seen  in  the  information  summarized  by  the  tables  provided 
in  Appendix  E,  we  observed  977  instances  of  training  in  various  group  settings,  i.e.  entire  class, 


7  Although  not  the  only  significant  predictor;  note  the  significant  correlation  between  experience  and 
performance. 
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half  class,  large  group,  small  group,  and  divided  small  group.  Within  these  settings,  we 
collected  data  from  460  instructor  interactions  and  1 1,672  student  interactions. 

The  second  objective  of  this  research  was  to  examine  small  group  processes  to  identify 
the  nature  and  extent  of  tailored  training,  determine  the  frequency  of  peer-to-peer  training 
interactions,  and  determine  if,  and  how,  tailoring  varied  with  group  size.  Given  the  nature  of  the 
small  group  training  we  observed  and  the  unit’s  interest  in  impacting  the  level  students  were 
engaged  during  training  when  not  perfonning  tasks,  our  analyses  focused  on  what  we  termed  a 
‘divided  small  group’.  This  setting  was  of  major  interest  because  (a)  it  was  the  most  commonly 
used  (and  hence  seen  as  effective)  by  the  course  instructors,8  (b)  it  had  aspects  of  both  a  one-on- 
one  tutorial  as  well  as  a  small  group  tutorial,  and  (c)  involved  hands-on  procedural  learning. 

This  last  point  is  of  particular  interest,  as  previous  tailored  training  research  has  largely  focused 
on  cognitive  tasks  (see  Schaefer  &  Dyer,  2013). 

While  a  few  classes  were  observed  as  they  watched  a  training  video  and  worked  in  the 
computer  lab,  no  data  was  collected  during  classroom  training  during  this  effort.  Nearly  all 
observed  training  was  either  conducted  on  the  actual  vehicles  or  in  a  Hands-on-Trainer  (HOT).9 
The  M2/M3  A2  Bradley  Operation  Desert  Stonn  (ODS)  and  the  M1A2  Abrams  System 
Enhanced  Package  (SEP)  HOTs  are  full-scale  replicas  of  the  turret  and  portions  of  the  driver's 
compartments  of  their  respective  vehicles  (see  Appendix  C  for  pictures  of  each  HOT  from 
Department  of  the  Army  (DA)  Pamphlet  350-9  [DA,  2010]).  Used  to  train  Soldiers  in 
maintenance  and  troubleshooting  tasks,  both  HOTs  have  rotating  turrets  and  main  guns  that 
elevate.  However,  these  functions  operate  at  slower  speeds  and  with  instructor  override  and 
emergency  motion  cut-off  switches  for  safety.  Both  HOTs  have  stations  that  allow  instructors  to 
run  lessons  replicating  various  vehicle  malfunctions  and  to  track  students’  progress  in  following 
proper  troubleshooting  procedures.  Computer  programs  control  visual  scenes  displayed  in  the 
sights  and  system  responses  to  inputs  from  switches  and  controls.  Incorrect  student  actions  are 
flagged  automatically  by  the  computer  for  future  or  additional  training.  Student  records  are 
saved  on  a  central  server  to  track  individual  student's  progress  over  time,  as  well  as  to  store  class 
data,  lessons  in  progress,  and  archival  perfonnance  data.  The  HOTs  support  training  in  system 
operation,  fault  diagnosis,  problem  troubleshooting,  system  adjustments,  component  removal  and 
replacement,  and  servicing  and  repairing  tasks.  Each  HOT  realistically  reflects  the  appearance 
and  internal  layout  of  its  operational  Abrams  and  BFV  counterparts. 

Divided  small  group  setting.  In  the  typical  divided  small  group  setting,  Soldiers  and 
instructors  were  arranged  as  shown  in  Figure  3.  A  single  student  and  instructor  pair  (indicated 
by  the  gray  and  black  dots)  are  located  on  the  equipment  (either  a  HOT  or  an  actual  vehicle), 
while  the  2-3  remaining  members  of  the  small  group  are  seated  at  nearby  tables  and  chairs. 


8  The  programs  of  instruction  (POIs)  for  both  Abrams  and  Bradley  courses  stipulate  that  approximately 
80%  of  the  group  settings  occur  in  divided  small  groups.  The  occurrence  rate  of  divided  small  group  training 
observed  during  the  three  weeks  of  observation  for  the  Abrams  was  75%  and  Bradley  Control  (71%).  However,  this 
dropped  to  7%  for  the  Bradley  BRITE  class  (see  Tables  E-7  through  E-9).  As  discussed  later  in  this  report,  this  was 
due  to  the  manner  in  which  the  BRITE  technologies  were  employed. 

Q  Although  the  HOT  used  in  91 A  training  was  also  referred  to  as  the  hands-on  turret  trainer  (HOTT),  the 
acronym,  HOT,  will  be  used  throughout  this  report  to  refer  to  both  types  of  maintenance  trainer  simulators. 
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Figure  3.  Divided  small  group  setting. 

The  students  at  the  table  are  ideally  engaged  in  a  related  or  preparatory  task  while  waiting 
their  turn.  Instructors  were  careful  to  involve  the  students  at  the  table  in  the  learning  process  as 
they  worked  with  the  primary  student  collocated  with  them  on  the  equipment.  Given  that 
training  related  interactions  between  the  instructor  and  the  student  in  the  one-on-one  setting 
within  the  vehicle  or  HOT  would  naturally  occur  with  such  frequency  and  rapidity  as  to  make  it 
nearly  impossible  to  accurately  track,  it  was  decided  to  focus  rather  on  the  training  related 
interactions  between  the  instructor  and  the  students  located  at  the  nearby  chairs/tables  and 
among  those  students.  This  information  was  gathered  via  Section  Ha  of  the  observation  form 
(see  Appendix  B).  As  noted  in  Tables  3  and  4,  the  divided  small  group  setting  is  described  in 
terms  of  three  types  of  behaviors:  instructional  styles  (e.g.,  a  global  description  of  the  type  of 
activity  the  instructor  is  engaging  in,  e.g.,  problem  solving,  guided  discussion),  instructor 
interactions  (e.g.,  asks  students  questions,  directs  students  to  complete  a  task,  designates  a 
leader)  ,  and  student  interactions  (e.g.,  answers  questions,  completes  a  directed  task,  takes  on  a 
leadership  role). 

Abrams  divided  small  groups.  By  far  the  most  common  group  setting  (as  expected) 
was  the  divided  small  group  (75%  of  group  observations).  The  most  common  instructional  style 
used  to  engage  observing  Soldiers  in  the  divided  small  group  was  problem  solving  (84%),  with 
all  other  styles  occurring  5%  or  less  of  the  time.  The  most  common  instructor  interactions  with 
these  Soldiers  involved  directing  students  to  complete  a  task  (83%)  and  asking  students  a 
question  (14%).  The  most  common  behaviors  exhibited  by  the  observing  Soldiers  in  the 
divided  small  group  involved  answering  questions  (36%),  completing  directed  tasks  (25%),  and 
asking  questions  (23%)  (see  Tables  E-8  to  E-10  for  details). 

Bradley  control  divided  small  groups.  Again  as  expected,  the  most  common  small 
group  training  setting  was  the  divided  small  group  (71%).  The  most  common  instructional  style 
used  to  engage  observing  Soldiers  was  problem  solving  (90%)  with  all  other  styles  occurring  less 
than  5%  of  the  time.  The  most  common  instructor  interactions  with  these  Soldiers  were  directing 
tasks  (43%),  asking  questions  (33%),  and  reviewing  content  (24%).  The  most  common  student 
behaviors  were  answering  questions  (38%),  completing  directed  tasks  (26%)  and  asking 
questions  (24%)  (see  Tables  E-l  1  to  E-13  for  details). 
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Bradley  BRITE  divided  small  groups.  Contrary  to  the  established  pattern,  the  divided 
small  group  was  not  the  most  common  group  setting  (7%)  in  the  BRITE  training  condition. 
Rather,  undivided  small  groups  and  larger  student  groups  were  more  frequently  observed  in  this 
condition  (see  Figure  4).  The  most  common  instructional  style  used  to  engage  observing 
Soldiers  was  still  problem  solving  (89%),  but  guided  discussion  were  much  more  frequently 
used  (11%)  than  seen  in  the  Bradley  Control  classes.  The  most  common  instructor  interaction 
with  observing  Soldiers  involved  asking  questions  (92%).  The  most  common  student  behaviors 
in  this  subgroup  were  answering  questions  (38%),  asking  questions  (24%),  and  completing 
directed  tasks  (26%)  (see  Tables  E-14  to  E-16  for  details).  While  the  observing  students’ 
behavior  patterns  are  similar  between  the  Bradley  Control  and  BRITE  conditions,  the  frequency 
of  group  setting  and  nature  of  instructor  interactions  with  this  subgroup  was  not,  as  illustrated 
by  Figures  4  and  5. 

Divided  small  groups  in  Bradley  control  vs.  BRITE  conditions.  In  Figure  4,  it  is  clear 
that  the  Bradley  Control  (91M05)  class  was  most  frequently  small  and  divided  group  oriented. 
On  the  other  hand,  the  Bradley  BRITE  (91M06)  course  was  most  frequently  the  large  group, 
half  class,  and  entire  class  settings,  although  it  was  still  more  small  group  oriented  than  not. 
Understanding  why  this  happened  is  crucial,  as  it  relates  to  the  outcomes  of  our  prediction 
models  (the  first  research  objective)  and  BRITE ’s  potential  impact  on  training.  Figure  5 
illustrates  how  heavily  question-focused  the  instructional  interactions  became  in  the  BRITE 
class. 


Entire  Class 

Half  Class 
Large  Group 
Small  Group 
Divided  Small  Group 


Control  (91M05) 
■  BRITE  (91M06) 
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Figure  4.  Frequency  of  group  setting  in  Bradley  Control  and  BRITE  classes. 
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Figure  5.  Instructor  interactions  in  Bradley  Control  and  BRITE  classes. 


Recall  that  Figure  3  introduced  the  typical  divided  group  setting.  However,  the  typical 
setting  did  not  often  occur  in  the  Bradley  BRITE  class.  This  was  due  to  the  way  in  which  the 
BRITE  technology  was  employed.  It  was  originally  projected  that  the  BRITE  class  would  have 
multiple  MCTs  available  for  a  class.  However,  only  one  was  purchased  and  available  for  the 
class  we  observed  during  this  research.  In  addition,  the  helmet  cameras  that  were  designed  to 
project  internal  vehicle  views  onto  the  Smartboard  so  that  observers  could  easily  see  and  follow 
the  training  were  unreliable  and  often  not  functional.  Thus,  much  of  the  dynamic  training 
capability  envisioned  for  the  MCT  was  not  available.  Therefore,  the  instructors  opted  to  load 
schematics  onto  the  Smartboard  and  drill  students  in  their  use,  while  one-on-one  training 
occurred  on  the  HOTs.  When  the  camera-MCT  connection  worked,  instructors  had  to 
experiment  with  it  to  get  the  best  view  of  training  within  the  vehicle  or  HOT  since  no  prior 
training  or  guidance  on  its  use  had  been  provided. 


Consider  Figure  4  which  illustrates  how  employing  the  technology  in  this  fashion 
impacted  the  divided  small  groups.  Instead  of  instructors  interacting  with  2-3  observing 
Soldiers  located  at  nearby  tables  and  chairs,  observing  Soldiers  were  combined  in  the  larger 
group  setting  seen  in  the  middle  of  Figure  4.  Note  that  this  setting  also  explains  why,  although 
documentation  of  instructor  interactions  showed  many  more  questions  being  asked  in  the 
Bradley  BRITE  condition  than  in  the  Control,  there  was  no  appreciable  shift  in  observing 
student  interactions  indicating  they  were  answering  more  questions  than  students  in  the  Control 
group.  In  the  modified  divided  small  group  setting  shown  in  Figure  6,  an  instructor  may  ask 
many  more  questions,  but  the  odds  that  the  students  being  tracked  by  the  observers  will  answer 
that  question  is  much  lower  since  they  are  part  of  a  much  larger  group  of  potential  respondents. 
Observers  described  how  this  led  to  a  24: 1  student  to  instructor  ratio  in  the  group  seated  near  the 
Smartboard,  compared  to  a  4:1  ratio  in  the  typical  small  group  setting. 
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Figure  6.  Modified  divided  small  group  setting  in  Bradley  BRITE. 


In  sum,  it  appears  that  the  most  common  instructional  style  used  to  engage  students  was 
problem-solving,  where  instructors  directed  students  to  complete  tasks  and  answer  questions.  In 
turn,  as  might  be  expected,  interactions  between  observing  students  and  their  instructors  were 
largely  answering  questions  and  completing  directed  tasks.  Other  behaviors  that  were  tracked  to 
better  understand  the  nature  of  ongoing  student  engagement  (e.g.,  offering  peers  help,  or  self- 
adopting  a  leadership  role)  occurred  infrequently.  The  major  observation  emerging  from  these 
small  group  observations  revolves  around  the  way  the  limited  technology  implementation 
impacted  group  settings  and  training  interactions. 


BRITE  Technology  Assessment 

The  final  objective  of  this  research  was  to  examine  the  effectiveness  and  other  impacts  of 
the  BRITE  technologies  employed  in  the  observed  Test  91M  class  (i.e.,  06M)  on  established 
training  outcomes. 

Controlling  for  individual  differences.  Before  any  causal  inference  regarding  the 
impact  of  BRITE  upon  performance  can  be  made,  it  is  necessary  to  determine  if  there  were  any 
significant  pre-existing  differences  between  the  participating  classes  (i.e.,  in  prior  knowledge, 
GT  scores,  or  experience)  that  could  have  impacted  our  findings.  A  multivariate  ANOVA  (see 
Table  E-17)  showed  there  were  no  significant  differences  between  the  Soldiers  in  these  two 
conditions. 


Performance  comparison  for  Bradley  Control  vs.  BRITE.  While  the  performance 
(Go  Percent)  was  virtually  identical  for  the  Bradley  Control  vs.  BRITE  classes  (see  Table  E-18), 
there  were  indications  that  the  BRITE  technology  appeared  to  help  individuals  who  were  lower 
in  experience,  prior  knowledge,  and  ability.  First,  sticking  solely  to  the  performance  data  from 
the  two  courses,  it  appears  while  the  mean  Go  Percent  rates  are  the  same,  there  are  differences 
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in  the  ranges  of  these  rates.  In  the  Bradley  Control  class,  the  minimum  score  is  58%,  while  in 
the  Bradley  BRITE  it  is  75%.  This,  along  with  the  near  identical  profiles  of  the  two  classes  on 
the  individual  difference  measures,  suggests  that  poorer  performers  appear  to  gain  more  from 
the  BRITE  condition  than  the  remaining  Soldiers  in  the  class. 

Second,  consider  the  pattern  of  correlations  seen  in  Figure  2.  In  the  Bradley  BRITE 
class,  the  correlations  between  predictor  and  criterion  variables  were  attenuated  and  in  one 
instance  reversed.  This  is  consistent  with  a  training  effect  that  is  impacting  the  scores  of  poorer 
perfonners  more  than  other  individuals  in  the  same  group. 

Finally,  bringing  all  observing  Soldiers  together  in  a  single,  large  group  under  the  tutelage 
of  other  instructors,  allowed  instructors  to  focus  their  complete  attention  to  a  single  student  in 
the  HOT  or  on  the  equipment.  Rather  than  having  to  divide  their  attention  between  a  student 
directly  engaged  in  a  training  activity  and  those  observing  the  training,  they  could  work  at 
length  and  in  greater  depth  with  a  single  student  without  concern  that  it  was  taking  away  from 
the  observing  students’  training  experiences. 

Qualitative  Training  Observation  Themes  and  Issues 

As  described  earlier,  qualitative  assessments  were  collected  from  SME  observers  at  the 
end  of  each  scheduled  training  day  and  week.  Daily  summary  conclusions  and  observations 
were  recorded  in  Part  IV  of  the  observation  instrument  (see  Appendix  B).  This  fonn  included  12 
questions  asking  the  observer  to  subjectively  rate  his  overall  impressions  of  the  day’s  activities. 

In  addition,  the  observers  provided  weekly,  written  summaries  of  their  observations  reflecting 
their  consolidated  thoughts  and  impressions  of  the  training  events  observed  during  the  previous 
week.  When  combined,  these  subjective  assessments  identified  a  number  of  training  themes  and 
issues  shared  by  both  training  programs  and  unique  to  each  AIT  course. 

Shared  observation  themes  and  issues.  Soldier  engagement  appeared  to  be  highest 
during  tasks  requiring  the  direct  participation  of  the  entire  group  or  team,  such  as  pulling  or 
reinstalling  an  engine  or  replacing  a  shock  absorber  or  torsion  bar.  These  types  of  training 
events  required  the  trainer  and  all  members  of  the  student  group  to  interact  and  communicate 
until  the  task  was  completed.  These  training  events  were  consistently  described  by  students  as 
“interesting  and  enjoyable,”  as  they  required  the  students  to  actually  use  their  tools  and  learned 
skills.  In  contrast  to  these  active  “wrench  turning”  tasks,  more  cognitively  based  tasks  tended  to 
be  described  by  students  as  more  difficult  and  less  hands-on.  Unlike  the  more  applied  tasks, 
these  tasks  involved  a  great  deal  of  passive  observation  and  tended  to  lose  students’  interest  very 
quickly. 

While  “doing”  clearly  seemed  to  be  the  preferred  method  of  training  from  both  the  point 
of  view  of  students  and  instructors,  limitations  of  available  facilities  and  operational  equipment 
frequently  restricted  the  number  of  opportunities  each  student  had  to  perfonn  a  scheduled  task. 

As  described  earlier,  largely  passive  observation  of  other  students  perfonning  tasks  was  all  too 
frequently  the  most  common  training  experience  during  the  day.  This  problem  was  exacerbated 
by  the  fact,  based  on  training  observations  and  feedback  provided  by  instructors  and  staff,  that 
training  equipment  and  vehicles  were  often  out  of  date  and  frequently  not  available  to  train  all 
scheduled  tasks  due  to  a  lack  of  adequate  replacement  parts.  Access  to  updated  simulators,  i.e. 
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fully  instrumented  hands-on  trainers  (HOTs),  helped,  at  least  partially,  address  some  of  these 
issues  during  training. 


Training  conducted  using  the  HOTs  consistently  received  positive  comments  from  a 
majority  of  students  during  our  observations.  Based  on  student  and  instructor  comments,  the 
greatest  strength  of  this  training  setting  was  that  it  allowed  students  to  diagnose  and  work  on 
problems  without  fear  of  destroying  a  costly  component  or  vehicle.  However,  a  number  of 
significant  issues  were  noted  with  the  HOTs’  operations  during  the  course  of  our  training 
observations.  The  following  were  identified  by  our  SMEs  as  most  noteworthy  as  they  directly 
impacted  the  quality  and  duration  of  training  opportunities  provided  to  individual  students  in  the 
HOTs: 


•  Computer  software  glitches  required  systems  to  be  rebooted,  which  took  a  substantial 
amount  of  time  away  from  training. 

•  Systems  overheated  and  quit  functioning  during  training  events. 

•  Systems  had  been  used  so  often  for  training  that  some  of  the  components  were  worn  out 
and  would  not  function  or  seat  properly. 

•  Students  (and  instructors)  inadvertently  broke  a  component  resulting  in  unplanned 
downtime  for  the  HOT  and  requiring  the  group  to  either  move  to  another  station,  if 
available,  or  join  another  group. 

•  Previous  classes  or  training  groups  failed  to  assemble  or  reconfigure  all  the  components 
properly  which  required  corrective  action  before  any  additional  training  could  take  place. 

Observers  also  noted  that,  in  addition  to  the  number  of  functioning  stations,  student 
engagement  in  training  events  employing  the  HOTs  and  armored  vehicles  was  frequently 
constrained  by  the  physical  configuration  of  the  equipment  and  limited  space  within  the  vehicle 
or  HOT.  Observing  students  frequently  found  it  difficult  to  see  exactly  what  was  going  on 
within  the  vehicle  or  HOT,  especially  when  trying  to  discern  what  the  student  inside  the 
compartment  was  referencing,  seeing  on  digital  displays,  and  doing  with  various  components, 
equipment,  or  cables.  Under  these  circumstances,  students  became  quickly  disinterested  in 
actively  observing  the  activities  within  the  compartment  and  spent  much  of  their  time  simply 
talking  or,  at  times  unsuccessfully,  trying  to  stay  awake. 

Instructors  were  consistently  observed  providing  thorough,  detailed  answers  to  all  student 
questions.  Simple  “yes”  and  “no”  responses,  with  no  elaboration,  were  very  seldom  heard 
during  the  training  observations.  The  SME  observers  noted  a  consistent,  conscientious  effort  on 
the  part  of  all  instructors  to  provide  complete  answers  to  student  questions.  The  instructors 
seemed  to  go  out  of  their  way  to  provide  detailed  answers  and  to  ensure  everyone  in  the  group 
understood,  even  to  the  point  of  frequently  having  the  group  huddle  around  the  component, 
inspection  point  and  breakout  box,  or  schematic  while  the  instructor  clarified  a  point  or  answered 
the  question.  Additionally,  the  instructors  seemed  to  rely  upon  the  students’  questions  to  gauge 
their  level  of  comprehension.  Most  of  the  instructors  routinely  followed  up  with  additional 
examples,  reviewed  previously  covered  materials  or  related  content,  and  asked  follow-up 
questions  of  their  own  to  ensure  students  adequately  understood  the  explanation  or  relationship 
between  presented  examples. 
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Unique  91A  observation  themes  and  issues.  Instructors  seemed  to  have  been  provided 
the  latitude  to  readily  adapt  training  to  fit  individual  student  needs  or  adjust  to  unforeseen  issues 
regarding  the  availability  of  training  equipment,  instructors,  or  students.  Training  observers 
frequently  noted  the  following  efforts  by  instructors  to  adapt  to  emerging  situations  and  to  ensure 
all  students  were  actively  engaged  during  training: 

•  While  an  instructor  was  on/in  the  tank  or  HOT  working  with  a  single  student,  the 
remaining  students  were  actively  working  on  another  assigned  task  or  training  problem. 

•  All  students  were  directed  on/in  the  tank  or  HOT  to  accomplish  a  single  task  or  separated 
into  smaller  groups  or  pairs  to  complete  multiple  related  tasks  concurrently,  as  the 
instructor  moved  between  tasks  as  needed  to  observe  each  activity  and  maintain  direct 
control  of  the  training  condition  and  progress.  Additionally,  instructors  often  rotated 
students  between  the  tasks  and  required  crew  roles. 

•  A  Soldier  or  pair  of  Soldiers  was  directed  to  work  on  a  task  on  their  own  on/in  the  tank  or 
HOT,  while  the  instructor  devoted  his  attention  to  working  with  the  remaining  students  at 
the  table. 

Student  groups  were  often  observed  working  on  tasks  that,  while  part  of  the  TSP  Training 
Annex,  were  not  scheduled  as  the  primary  focus  of  that  specific  training  session  or  day. 
Instructors  appeared  free  to  alter  the  planned  sequence  of  tasks  for  the  day  or  the  week  based  on 
equipment  availability,  student  progress,  or  even  their  own  discretion.  Observers  noted  that  the 
instructors  carefully  tracked  the  progress  of  each  student  to  assure  satisfactory  completion  of  all 
required  tasks  in  accordance  with  the  standards  and  conditions  set  in  the  approved  TSPs. 

As  discussed  earlier,  availability  of  parts  for  repairing  the  aging  tank  fleet  hindered 
training  and  extended  time  required  for  evaluations  due  to  restricted  numbers  of  operational 
stations  or  the  limited  availability  of  an  essential  subsystem,  part,  or  tool.  Typical  examples 
noted  by  training  observers  included: 

•  During  fire  control  maintenance  training,  a  single  commander’s  control  handle  was 
passed  between  three  tanks.  This  tool  is  an  essential  component  in  the  conduct  of  a 
number  of  common  troubleshooting  tasks  and  the  instructors  only  had  one  available  for 
training  use  during  three  consecutive  training  days. 

•  An  unexpected  fault  occurred  in  a  tank  turret  during  the  practical  evaluations,  burning  out 
a  breakout  box  and  removing  the  tank  from  further  evaluations  and  training,  thus  slowing 
throughput. 

•  During  hull  training,  instructors  had  to  correct  multimeter  readings  or  verbally  inform 
students  of  the  “results”  of  a  test  process  because  of  preexisting  unreconciled  faults  on 
the  available  tanks. 

•  During  suspension  training,  parts  had  been  removed  and  replaced  by  students  so  often 
that  connectors  and  threads  were  too  worn  to  be  properly  secured,  thus  reducing  the 
realism  of  the  training.  Specifically,  observers  noted  that  a  number  of  transmission  bolts, 
bolts  on  suspension  parts  and  assemblies,  and  solenoid  connectors  on  the  transmission 
were  too  worn  and  broken  to  meet  operational  and  training  standards. 
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As  they  distracted  instructors  and  students  from  the  task  at  hand,  these  issues  delayed  training, 
created  unrealistic  conditions  for  training,  and  provided  these  developing  vehicle  maintainers 
with  a  training  experience  that  fell  short  of  the  conditions  and  standards  required  by  the  POI  and 
TSPs. 


Unique  91M  observation  themes  and  issues.  In  contrast  to  their  91 A  counterparts, 
observers  noted  that  91M  instructors  appeared  to  have  very  little  latitude  to  vary  from  the 
prescribed  instruction  schedule.  Typically,  instructors  were  held  to  planned  training  schedules 
where  instructors  were  expected  to  teach  the  same  content  during  the  same  time  blocks.  In  many 
cases  when  a  group  completed  a  planned  training  session  earlier  than  scheduled,  they  had  to  wait 
for  the  remaining  groups  to  catch  up  before  proceeding  to  the  next  task.  Depending  on  how  far 
they  were  ahead  of  any  remaining  groups,  instructors  rotated  the  students  through  previously 
completed  tasks,  reviewed  course  materials  with  the  students,  began  preparing  them  for  the  next 
scheduled  task,  or  simply  left  them  to  their  own  discretion  until  they  could  move  on  to  the  next 
scheduled  event. 

Consistent  with  their  91 A  counterparts,  the  most  commonly  observed  small  group 
training  strategy  used  by  instructors  was  to  work  directly  with  a  student  to  perfonn  a  task  or 
troubleshoot  a  procedure  on/in  a  vehicle  or  HOT  while  the  remainder  of  the  group  passively 
observed.  Most  of  the  instructors  seemed  continually  challenged  to  both  observe  the  focal 
student’s  actions  and  keep  the  remaining  students  actively  engaged  in  the  training. 
Troubleshooting  task  steps  and  procedures  were  particularly  lengthy,  providing  extensive  periods 
where  students  attempted  to  observe  training  activities  inside  the  vehicle  or  HOT.  While 
observing  students  were  supposed  to  be  actively  following  the  focal  student’s  actions,  most 
engaged  in  social  chatter  or  passively  sat,  waiting  for  their  turn  and  trying  to  stay  awake.  There 
were  long  periods  of  time  where  there  were  no  interactions  between  the  instructors  and  the 
observing  students.  It  readily  appeared  that  once  the  observing  students  believed  they 
understood  the  task,  either  by  perfonning  the  process  themselves  or  by  observing  other  students 
perform  it  repeatedly,  they  quickly  lost  interest  in  the  training  session. 

Focusing  on  training  conducted  using  the  BRITE  technologies,  it  appeared  that  training 
conducted  using  the  MCT  was  not  well  received  by  students.  Regardless  of  how  instructors 
attempted  to  use  the  MCT,  the  majority  of  students  only  passively  observed  the  training,  if  at  all. 
At  most,  only  one  or  two  students  were  actively  involved  at  the  Smartboard  trying  to 
demonstrate  the  troubleshooting  procedures  needed  to  resolve  a  presented  problem  using  an 
electronic  schematic.  Some  of  the  most  significant  issues  with  the  MCT  seemed  to  have  more  to 
do  with  the  manner  in  which  the  technology  was  employed  than  the  equipment’s  capabilities. 
Issues  that  observers  most  frequently  noted  included: 

•  The  MCT  was  only  observed  being  used  in  large  group  settings  and  was  not  observed 
being  directly  used  by  an  instructor  with  individual  small  training  groups. 

•  Instructors  appeared  to  lack  adequate  training  on  the  MCT’s  capabilities  and  operations, 
troubleshooting  procedures,  and  training  content.  Frequently,  students  seemed  to  know 
more  about  its  operation  than  many  of  the  instructors,  which  appeared  to  reduce  the 
motivation  of  many  instructors  to  experiment  with  the  device. 
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•  Students  at  the  board  frequently  blocked  other  students’  view  of  what  exactly  they  were 
doing.  Frequently,  they  were  not  required  to  verbally  walk  through  their  actions  or 
problem  solving  process  as  they  completed  the  task  for  the  benefit  of  observing  students. 

•  Diagrams  and  schematics  presented  on  the  board  were  often  hard  to  read  from  various 
sitting  positions  and,  at  times,  students  had  to  refer  to  a  paper  copy  to  determine  what 
exactly  was  written  or  displayed  on  the  board. 

•  Instructors  were  actively  involved  with  one  or  two  students  at  the  board  and  largely 
ignored  the  rest  of  the  class. 

•  The  board  was  frequently  used  as  a  “babysitter”  for  a  majority  of  the  students,  while 
individual  instructors  worked  with  a  single  student  back  at  their  training  stations. 

•  After  a  few  repetitions  of  using  the  MCT  for  the  same  type  of  training  activities,  the 
excitement  of  a  new  piece  of  equipment  wore  off  and  students  became  disinterested. 

•  Limited,  repetitive  activities  were  conducted  using  the  board,  as  it  was  mainly  used  to 
provide  live-feeds  from  the  portable  helmet  camera  and  trace  wiring  faults  with  a  digital 
highlighter. 

Attempts  to  use  the  MCT  were  only  observed  in  conjunction  with  training  on  the  HOTs. 
There  were  a  number  of  issues  noted  by  observers  during  the  use  of  live  feeds  during  training  on 
HOTs.  While  the  HOT  has  more  internal  room  than  an  actual  BFV,  it  is  still  a  cramped, 
constrained  operating  environment.  When  the  helmet  camera  was  placed  on  a  student 
perfonning  a  task,  the  following  issues  emerged: 

•  The  feed  from  the  mounted  camera  was  often  not  focused  on  what  the  student  was  doing. 
For  example,  a  task  may  require  a  student  to  disconnect  a  cable  by  reaching  around  or 
behind  a  component  in  such  a  way  that  even  the  student  perfonning  the  tasks  cannot  see 
well.  In  such  confined  conditions,  the  student  simply  could  not  position  his  head  for  the 
camera  to  capture  what  is  happening. 

•  When  strapped  to  a  student’s  head,  the  camera  was  often  an  obstruction  to  a  student’s 
movements  and  endangered  the  equipment  as  it  frequently  knocked  into  a  number  of 
components. 

•  The  camera’s  display  could  not  adequately  capture  what  the  student  read  from  a  manual 
or  a  digital  display. 

•  Unless  the  student  or  instructor  narrated  exactly  what  was  taking  place,  observing 
students  were  frequently  lost  and  unable  to  follow  the  procedure. 

•  Audio  feed  from  inside  the  HOT  was  terrible  and,  even  with  narration,  it  was  consistently 
hard  to  hear  and  understand  what  was  happening  inside  the  HOT. 

Focus  Group  Interview  Themes  and  Findings 

To  gather  data  during  the  focus  group  interview  sessions,  an  interviewer  and  a  researcher 
took  notes  on  the  discussion.  Their  notes  were  compared,  consolidated,  and  transcribed  into 
central  files  for  each  class  which  were  then  reviewed  by  other  members  of  the  research  team  to 
verify  their  accuracy,  consistency,  and  comprehensiveness.  During  the  discussions  that 
followed,  the  research  team  distilled  the  themes  into  essential  points  that  described  similarities 
and  differences  among  the  comments  from  the  sessions.  This  qualitative  data  provided  insights 
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into  how  Soldiers  and  instructors  viewed  the  training  during  AIT  in  general,  and  the  employment 
of  BRITE  technologies,  specifically. 


Soldier  focus  group  interviews.  As  described  previously,  interviews  were  conducted 
with  each  of  the  observed  Soldier  focus  groups,  comprised  of  three  to  five  Soldiers  each.  Fifteen 
interview  sessions  were  conducted  with  eight  groups  from  the  91M  (BFV)  classes  and  seven 
from  the  91 A  classes.  A  total  of  69  Soldiers,  35  91 A  students  and  34  91Ms,  were  interviewed. 

Shared  interview  themes.  The  Soldiers  we  interviewed  indicated  they  generally  had 
adequate  hands-on  time  with  the  equipment,  with  the  exception  of  when  groups  expanded  to 
more  than  four  students  or  when  the  tasks  became  more  complex.  As  tasks  increased  in 
complexity,  they  took  more  time  to  complete  and  provided  fewer  opportunities  for  everyone. 
They  also  described  how  students  in  a  group  were  often  distributed  throughout  the  other  groups 
during  an  instructor’s  absence.  This  increased  the  number  of  students  in  that  group  during  that 
portion  of  training  and  decreased  the  amount  of  time  each  student  had  perfonning  hands-on 
tasks. 


Students  readily  admitted  they  became  easily  bored  and  disinterested  while  waiting  their 
turn  to  participate  in  hands-on  training.  When  asked  how  they  typically  used  this  dead  time,  the 
most  common  responses  were  nearly  equally  divided  between  talking  with  other  students  about 
non-training  related  issues,  sleeping,  and  trying  to  stay  awake.  The  students  we  interviewed 
indicated  that  keeping  them  more  involved  in  hands-on  training  through  additional  instructors, 
additional  equipment,  and  smaller  group  sizes  would  greatly  benefit  training  and  relieve  these 
periods  of  boredom. 

Students’  comments  regarding  use  of  technical  equipment  varied  depending  on  the  type 
of  equipment  and  how  it  was  employed  during  their  training.  For  example,  students  in  the 
Abrams  maintenance  classes  positively  described  the  use  of  vehicle  digital  trainers  (VDTs)  in 
their  training,  but  expressed  concerns  with  how  the  software  handled  errors.  Their  counterparts 
in  the  BFV  maintenance  classes  reported  not  using  VDTs  during  any  portion  of  their  hull  and 
turret  training.  Overall,  the  students  we  interviewed  preferred  training  on  live  vehicles  as 
opposed  to  using  any  of  the  other  training  aids,  virtual  or  real.  A  major  exception  to  this 
perspective  was  the  students’  reactions  to  the  HOTs.  Students  generally  liked  the  HOT  because 
it  closely  resembled  a  live  vehicle,  while  still  requiring  active  hands-on  wrench  turning  and  use 
of  maintenance  equipment.  Further,  as  a  simulator,  it  significantly  reduced  their  fears  of  making 
a  mistake  that  would  damage  a  live  vehicle. 

Unique  91A  themes.  There  were  some  notable  differences  in  student  responses 
regarding  the  use  of  VDTs  during  Abrams  training.  Students  in  91A07  described  the  VDT  as  a 
negative  training  aid  that  hindered  their  learning,  while  those  from  91A08  described  it  in  positive 
terms.  Students  in  91A07  discussed  how  they  were  frequently  frustrated  with  the  simulated 
troubleshooting  capabilities  of  the  VDT  for  training.  Specifically,  they  reported  that  the  software 
would  lock  them  out  once  it  detected  they  had  perfonned  a  step  incorrectly,  but  it  would  not 
identify  the  exact  incorrect  action.  Even  after  the  instructor  reset  the  simulation,  students  still 
did  not  know  what  they  had  perfonned  incorrectly  and  frequently  committed  the  same  error. 
Therefore,  they  gave  the  simulator  low  marks.  However,  students  in  91A08,  in  contrast,  gave  the 
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system  high  marks.  Based  on  further  elaboration,  the  difference  appeared  to  be  that  the  91A08 
class  primarily  used  the  VDT  capabilities  that  allowed  for  familiarization  with  identified  tank 
components  prior  to  the  students  training  on  the  actual  equipment.  The  students  seemed  to  find 
this  capability  helpful  and  did  not  experience  the  same  frustrations  with  the  VDT  as  members  of 
the  91A07  class  who  had  attempted  to  complete  more  complex,  scenario-based  problems 
presented  in  the  VDT. 

Unique  91M  themes.  Regarding  the  employment  of  the  MCT  in  Bradley  classes, 
students  stated  that  the  biggest  issue  they  had  was  with  the  manner  in  which  the  MCT  was 
employed  rather  than  the  equipment  itself.  Students  generally  did  not  like  the  use  of  the  MCT  in 
their  classes.  They  indicated  that  the  use  of  the  helmet  camera  was  useless  unless  there  was  an 
instructor  narrating  the  procedure.  Even  then,  watching  the  live  feed  quickly  became  boring  and 
monotonous,  as  students  quickly  became  disinterested  after  only  a  few  repetitions. 

Students  seemed  to  be  split  on  the  use  of  the  MCT  for  tracing  schematics.  Students  that 
had  experienced  actively  tracing  wiring  faults  on  the  board  felt  it  was  somewhat  useful,  while 
other  students  who  spent  much  of  the  time  observing  saw  very  little  benefit  in  the  exercise.  The 
students  also  recommended  training  instructors  on  the  use  and  operation  of  the  technology,  as 
some  students  were  more  knowledgeable  than  their  instructors  on  its  operations  and  interactive 
features. 

There  was  also  a  wide  difference  in  student  responses  about  the  common  core  training. 

As  the  name  implies,  this  was  the  basic,  foundational  classes  the  Soldiers  completed  before 
beginning  their  hands-on  training.  Many  students  found  this  common  core  training  to  be  of  great 
benefit,  while  others  within  the  same  class  found  it  to  be  the  least  interesting,  most  boring  part  of 
the  course.  These  students  felt  that  much  of  the  material  was  useless  and  indicated  that  many  of 
the  things  learned  in  these  initial  classes  were  not  used  or  referenced  during  the  rest  of  their 
training. 

Trainer/instructor  focus  group  interviews.  As  described  earlier,  three  different  groups 
of  instructors  were  interviewed:  (1)  91M  BFV  instructors,  (2)  91 A  Abrams  hull  instructors,  and 
(3)  91 A  Abrams  turret  instructors.  The  same  group  of  91 A  instructors  conducted  hull  and  turret 
training  in  both  observed  classes.  Researchers  conducted  six  interview  sessions  with  focus 
groups  of  four  instructors  each.  Two  sessions  were  conducted  with  BFV  maintenance  instructors 
for  classes  05M  and  06M.  Four  sessions  were  conducted  with  Abrams  maintenance  instructors 
assigned  to  classes  07A  and  08A  (two  for  turret  instructors  and  two  for  hull  instructors).  Unless 
otherwise  stated,  the  results  summarized  in  this  section  reflect  the  infonnation  gained  from  all 
Abrams  instructors. 

Shared  interview  themes.  Instructors  reported  that  they  were  asked  to  provide  little  to  no 
input  during  the  process  of  assigning  Soldiers  to  their  small  training  groups.  According  to  the 
instructors  we  interviewed,  the  composition  of  the  small  training  groups  was  based  on  students’ 
scores  on  their  first  common  core  test  in  academics,  their  initial  Anny  Physical  Fitness  Test 
(APFT)  scores,  and  group  diversity  considerations.  The  instructors  pointed  out  that  while  some 
classes  used  additional  criteria  for  assigning  Soldiers  to  their  training  groups,  including 
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subjective  judgments  regarding  how  well  the  Soldiers  appeared  to  work  together,  attempts  were 
made  to  evenly  distribute  capabilities  and  balance  demonstrated  skill  levels  across  the  groups. 

The  instructors  felt  the  criteria  consistently  failed  to  reflect  the  Soldiers’  actual  potential 
for  learning  and  perfonning  maintenance  tasks.  They  indicated  that  early  academic  test  results 
and  general  physical  fitness  scores  do  not  consistently  translate  to  the  kind  of  hands-on 
maintenance  abilities  needed  to  succeed  in  training.  They  indicated  that  prior  mechanical 
experience  and  familiarization  with  vehicle  maintenance  tools  and  equipment  would  be  better 
indicators  of  key  abilities.  According  to  the  instructors  we  interviewed,  many  students  have  little 
to  no  practical  prior  experience  with  schematics,  wiring  diagrams,  tools,  mechanics,  system 
troubleshooting,  or  mechanical  repairs  before  reporting  to  AIT. 

Most  of  the  instructors  we  interviewed  felt  they  were  able  to  identify  those  students  that 
could  leam  and  perform  tasks  quickly  and  those  that  would  require  additional  attention  early  on 
in  the  training  cycle.  However,  they  had  great  difficulty  in  explaining  exactly  how  they  could 
determine  this  or  what  criteria  they  consistently  monitored  to  ascertain  a  student’s  potential  for 
later  success  in  training.  During  this  discussion,  they  highlighted  the  following  as  being  good 
indicators  of  later  performance: 

•  Observing  body  language  as  a  reflection  of  confidence  and  noting  how  long  it  took  for  a 
student  to  complete  tasks. 

•  Observing  which  students  take  the  lead  and  which  ones  often  choose  to  observe  others 
working  on  a  group  task. 

•  Observing  students’  interest  in  ongoing  tasks. 

•  Observing  the  number  and  nature  of  questions  asked  by  individual  students  during 
training  sessions. 

The  instructors  we  interviewed  highlighted  a  number  of  issues  that  challenged  their 
abilities  to  adjust  training  to  meet  the  needs  of  their  Soldiers.  In  addition  to  more  traditional 
constraints,  such  as  resource  limitations,  condition  of  available  equipment,  and  other  scheduled 
requirements  that  took  Soldiers  away  from  training,  the  instructors  pointed  out  how  language 
barriers,  previously  diagnosed  hyperactivity  conditions  requiring  medication,  and  other  learning 
factors,  such  as  apparent  learning  disabilities  and  concentration  issues,  impacted  training. 

During  our  discussion,  they  reported  frequently  using  the  following  techniques  in  order  to 
overcome  these  challenges  and  to  meet  their  Soldiers’  unique  training  needs: 

•  Had  other  students  wait  until  a  struggling  student  catches  up. 

•  Made  a  slower  student  the  initial  demonstrator,  thus  giving  that  student  additional 
opportunities  to  perfonn  the  task  later,  as  time  permits  and  after  observing  the  remaining 
students  complete  the  task. 

•  Ensured  a  struggling  student  was  last  to  perform  hands-on  training  so  the  student  could 
observe  and  leam  from  others  prior  to  attempting  the  task,  as  well  as  giving  the  instructor 
more  opportunities  to  spend  additional  time  with  that  student  during  the  session. 

•  Provided  struggling  students  more  opportunities  than  others  to  perform  tasks,  as  time 
permitted. 

•  Frequently,  verbally  quizzed  the  students  on  content  already  covered. 
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•  Paired  weaker  students  with  stronger  ones  who  could  act  as  peer  coaches. 

•  Had  students  explain  a  previously  reviewed  process  and  answer  questions. 

Instructors’  opinions  varied  greatly  when  asked  to  identify  what  was  most  challenging 
and  what  was  easiest  for  students  to  learn  during  training.  In  general,  complex  system  tasks 
requiring  a  number  of  inputs  from  related  subsystems  and  new  tasks  that  required  greater 
integration  of  multiple  content  areas  and  skills,  such  as  analytical  problem  solving,  logic,  and 
critical  thinking  skills  with  limited  or  no  prior  review,  seem  to  give  students  the  most  difficulty. 
They  emphasized  that  students  were  most  attentive  and  engaged  in  learning  when  performing 
hands-on  tasks.  Simple  tasks  that  were  relatively  easy  to  grasp  caused  students  to  quickly 
become  bored  and  disengaged  in  training,  especially  when  required  to  passively  observe  others 
perform  the  task  while  waiting  for  their  turn. 

Unique  91A  themes.  The  instructors  we  interviewed  emphasized  that,  with  the  exception 
of  a  single  EIM  group  in  each  class,  program  managers  generally  attempted  to  evenly  distribute 
student  capabilities  across  the  groups  within  each  class.  It’s  important  to  keep  in  mind  that  while 
EIM  Soldiers  were  placed  in  each  of  the  training  groups  in  91M  classes,  they  were  placed  in  a 
separate  group  in  91 A  classes.  This  allowed  this  group  to  pursue  an  accelerated  training 
schedule,  receive  training  on  a  number  of  additional  vehicle  issues  and  types  beyond  the 
established  POI,  and  be  used  as  a  reliable  source  of  peer  coaches  by  other  instructors. 

The  Abrams  instructors  interviewed  in  this  effort  indicated  that  the  performance  of  EIM 
groups  has  been,  at  best,  unpredictable  in  their  content  areas.  They  acknowledged  that  the  EIM 
group  members  tended  to: 

•  Be  older  (24  -  27),  more  mature,  and  more  focused  on  training. 

•  Have  more  formal  education  (including  some  college). 

•  Grasped  concepts  earlier  and  better  than  other  Soldiers  in  their  class. 

However,  they  also  pointed  out  that  they  found  most  EIM  groups  were: 

•  Frequently  less  capable  or  about  equal  to  their  classmates  in  actual  task  perfonnance  as  a 
mechanic. 

•  Not  necessarily  sharper  or  more  capable  than  their  peers,  but  more  consistently  able  to 
read  better. 

Unique  91M  themes.  The  Bradley  maintenance  instructors  we  interviewed  indicated 
they  observed  no  real  positive  impact  resulting  from  the  use  of  the  MCT.  They  stated  it  was 
most  effective  during  the  first  time  through  a  demonstration.  After  that  its  use  became  too 
repetitious.  Overall,  the  instructors  felt  that  the  MCT  was  a  good  idea  but  was  not  employed  in 
the  right  way.  They  felt  that  with  better  software,  better  instructor  training  on  the  use  of  the 
Smartboard  and  its  full  capabilities,  more  MCTs  (one  per  group),  and  more  advanced  capabilities 
(such  as  student  interactive  tablets  with  the  board)  the  MCT  could  be  a  useful  tool.  Specifically, 
they  indicated  that  MCT  activities  were: 

•  Too  repetitious.  Students  were  done  with  a  procedure  after  seeing  it  through  one  time. 
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•  Hard  to  see  when  students  were  standing  in  front  at  the  Smartboard  while  using  it. 

•  A  challenge  for  an  instructor  to  keep  all  students  interested  and  involved  in  training. 
Difficult  enough  with  a  small  group  of  4  to  5  students,  attempting  the  same  with  a  1 :30 
instructor  to  student  ratio  at  the  MCT  was  impossible. 

•  Time  consuming.  Training  time  was  allotted  for  each  procedure  but  currently  is  not 
structured  to  include  Smartboard  time. 

•  No  better  than  trying  to  watch  it  live  due  to  the  problems  experienced  trying  to  use  the 
helmet  camera. 


Conclusions  and  Recommendations 


Conclusions 

The  intent  of  this  effort  was  to  address  gaps  identified  in  previous  tailored  training 
research  in  institutional  training  programs  and  examine  specific  training  issues  raised  by  the  3- 
81st  AR  BN,  Fort  Benning,  GA.  Given  the  Armor  School’s  interest  in  identifying  or  developing 
more  effective  predictive  measures  for  their  courses,  this  effort  provided  a  unique  opportunity  to 
assess  the  effectiveness  of  various  types  of  prior  knowledge  predictors  administered  early  in  a 
course  to  predict  later  perfonnance  at  different  stages  of  training.  The  annor  vehicle 
maintenance  AIT  courses  examined  in  this  research  also  provided  an  excellent  opportunity  to 
observe  how  small  groups  function  in  technical  military  courses  and  further  examine  the  nature 
of  tailored  training  strategies  employed  in  these  settings.  Finally,  the  timing  of  this  effort 
provided  our  team  with  the  chance  to  assess  the  impact  of  the  initial  deployment  of  the 
centerpiece  of  the  BN’s  BRITE  technology  initiative,  i.e.  a  MCT,  on  training  strategies  and 
outcomes. 

Performance  predictor  measures.  As  described  earlier,  about  80%  of  the  scheduled 
training  in  the  annor  vehicle  maintenance  courses  we  examined  occured  in  assigned  small  group 
settings.  Identifying  technically  stronger  and  weaker  students  as  early  as  possible  is  critical  to 
the  training  strategies  employed  in  both  courses.  Whether  creating  EIM  groups  that  can  be 
placed  in  an  expanded,  accelerated  training  program  (i.e.,  91  A)  or  attempting  to  balance  the 
number  of  stronger  and  weaker  students  within  each  training  group  to  enhance  opportunities  for 
peer  coaching  (i.e.,  91M),  the  need  for  well-defined,  reliable  predictor  measures  to  assign 
students  as  required  is  paramount. 

Based  on  our  research,  assignment  to  the  small  training  groups  in  the  participating  classes 
was  based  on  measures  readily  available  before  the  start  of  small  group  hands-on  training. 
Although  instructors  and  course  leaders  also  used  individual  subjective  assessments  of  students’ 
relative  compatibility  and  other  various  implicitly  derived  attributes,  the  most  consistent 
measures  used  were  the  most  convenient:  GT  scores,  students’  scores  on  their  first  common  core 
test  in  academics,  initial  APFT  scores,  and  group  diversity  considerations.  According  to  our 
interviews,  these  measures  were  originally  believed  to  be  predictive  of  later  training  performance 
and  adequate  for  identifying  stronger  and  weaker  students  early  in  training.  Our  research  clearly 
showed  that  these  predictive  performance  measures’  predictive  value  was  not  validated  by  later 
student  perfonnance.  We  found  that  early  common  core  academic  test  results  and  APFT  scores 
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had  little  to  do  with  a  student’s  demonstrated  ability  to  leam  and  perfonn  maintenance  tasks 
well. 


Our  research  indicated  that  measures  designed  to  discern  a  student’s  entering  knowledge 
of  and  ability  to  complete  basic  underlying  tasks  relevant  to  later  learning  content  are  much  more 
predictive  of  later  performance  at  different  stages  of  training.  In  fact,  our  research  indicated 
measures  developed  with  an  understanding  of  the  critical  basic  skills  and  concepts  that  underlie 
key  perfonnance  activities  and  more  complex  skills  are  superior  to  established,  standardized 
cognitive  tests  and  basic  experiential  background  assessments.  Although  the  strategy  of  relying 
on  GT  scores  as  an  indicator  of  general  cognitive  ability  was  consistent  with  previous  research,  it 
lacks  the  more  detailed  insight  needed  for  instructors  to  effectively  tailor  training  and  group 
composition  on  the  basis  of  applied  skill  aptitudes.  Thus,  assessing  students’  knowledge  of  and 
ability  to  identify  basic  tools,  demonstrate  the  use  of  selected  tools,  demonstrate  an 
understanding  of  basic  electrical  components  and  functions  (e.g.,  completing  a  simple  circuit  or 
accurately  interpreting  a  basic  electrical  schematic),  or  past  mechanical  experiences  were  more 
effective  predictors  of  later  performance  in  the  armor  vehicle  maintenance  courses  we  examined. 

Tailored  training.  Our  research  focused  on  determining  how  instructors  attempted  to 
tailor  their  training  interactions  with  students  observing  hands-on  training  while  waiting  for  their 
turn  on  the  equipment.  Although  rarely  the  focus  of  previous  tailored  training  research,  these 
interactions  are  critical  to  the  emerging  training  experiences  and  outcomes  in  these  group 
training  settings.  Also,  the  normally  high  level  of  instructor-student  interaction  in  the  one-on- 
one  or  one-on-two  instructional  group  and  the  physical  impossibility  of  placing  an  observer  in  a 
position  to  accurately  document  the  interactions  occurring  within  both  subgroups  without 
disrupting  training  constrained  our  research  options.  However,  given  its  unique  focus,  this 
research  addressed  an  often  ignored  aspect  of  group  training  settings  and  expands  our 
understanding  of  how  instructors  tailor  training  to  keep  subgroups  of  students  engaged  when  not 
participating  in  hands-on  training. 

Given  the  physical  constraints  of  the  equipment  and  setting,  it’s  not  surprising  that  many 
instructors  participating  in  this  research  found  effectively  addressing  their  Soldiers’  needs  by 
dividing  their  attention  between  two  subgroups  an  often  impossible  task.  The  situation  was 
exacerbated  by  the  fact  that  the  equipment’s  design  frequently  prevented  or  hindered  the  ability 
of  observing  Soldiers  to  learn  vicariously  from  another  Soldier’s  actions.  Thus,  it  was  not 
surprising  to  leam  that  the  Soldiers  largely  bided  their  time  in  casual  activities  unrelated  to  the 
scheduled  training  events  as  they  waited  their  turn  on  the  equipment.  However,  even  within  this 
constrained  environment,  most  instructors  took  direct  actions  to  keep  Soldiers  engaged  during 
training.  Our  results  indicated  that  providing  problems  for  observing  Soldiers  to  work  on  and 
asking  them  simple,  direct  questions  were  the  most  common  strategies  for  instructors  to  gauge 
their  comprehension  and  understanding  of  the  ongoing  training  event. 

Our  research  also  indicated  that  strict  adherence  to  all  groups  sequentially  advancing 
through  planned  training  schedules  at  the  same  pace  severely  limited  instructors’  ability  to  tailor 
training  to  their  Soldiers’  needs  and  progress.  Without  the  ability  to  quickly  adjust  content 
delivery  to  match  the  pace  of  the  training  group’s  accomplishments,  or  to  take  advantage  of 
unanticipated  resources,  instructors  are  left  with  very  few  options  other  than  simple  repetition  of 
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a  completed  task  or  using  questions  to  keep  their  students  engaged  throughout  the  training  day. 
The  ability  of  91 A  instructors  to  alter  or  overlap  the  sequence  of  training  events  within  broadly 
defined  boundaries  was  key  to  their  effectiveness  to  tailor  training  in  a  manner  that  enhanced  the 
level  of  student  engagement  throughout  the  training  day.  Without  this  ability  to  adjust  scheduled 
training  events  and  engage  students  concurrently  on  multiple  tasks,  instructors  have  very  limited 
means  to  tailor  training  to  meet  the  needs  of  all  the  students  in  their  group.  Often,  students  are 
left  to  passively  observe  other  students  perfonning  a  procedure.  This  not  only  leads  to  boredom 
and  loss  of  interest  by  students,  it  undermines  an  instructor’s  ability  to  spend  greater  time  with 
struggling  students  without  adversely  impacting  the  training  experiences  and  opportunities  of 
other  students. 

BRITE.  As  described  earlier  in  this  report,  the  MCT  was  most  frequently  used  in  two 
ways:  first,  as  a  tool  to  have  students  troubleshoot  presented  electrical  problems  or  trace  and 
interpret  wiring  problems  on  a  schematic  diagram  and  secondly,  to  display  live  video  feed  from 
the  mounted  helmet  camera.  Due  to  the  fact  that  only  a  single  MCT  was  available,  students  were 
usually  brought  together  in  a  large  group  or  half  class  training  group  to  use  the  MCT. 

Regardless  of  how  the  MCT  was  employed,  the  vast  majority  of  students  in  the  MCT 
group  were  still  only  able  to  passively  observe  the  training  without  active  facilitation  by 
instructors  not  engaged  in  the  hands-on  training.  The  degree  to  which  facilitation  strategies  were 
effective  depended  upon  the  ability  of  instructors,  either  individually  or  in  collaboration,  to 
engage  a  large  group  of  students  in  active  learning  using  the  MCT,  the  availability  of 
preprogrammed  content,  and  the  level  of  comfort  an  instructor  had  with  operating  and 
troubleshooting  the  MCT.  Unfortunately,  the  instructors’  capabilities  in  each  of  these  areas  were 
greatly  constrained  by  the  facts  that  there  was  only  one  MCT  available,  instructors  had  not 
received  any  in-depth  training  on  the  MCT’s  capabilities  and  operation  prior  to  its  employment, 
and  a  lack  of  time  to  develop  and  integrate  preprogrammed,  validated  content  and  tailored 
training  strategies  for  exploiting  the  MCT  during  training  prior  to  this  research.  Thus,  it  was  not 
surprising  that,  after  the  first  few  iterations  of  limited  preprogrammed  content  or  presented 
schematic  problems,  the  observing  group  generally  became  disinterested,  distracted,  and  focused 
on  unrelated  activities,  e.g.  informal  social  exchanges  and  extended  personal  breaks  away  from 
the  training  area,  other  than  focusing  on  or  contributing  to  training. 

Given  these  constraints  and  limitations,  it’s  surprising  that  any  positive  trends  or 
outcomes  were  noted  regarding  the  BRITE  employment  during  this  effort.  Yet,  there  are 
indications  that  this  technology,  centered  on  the  use  of  a  single  MCT,  appeared  to  help 
individuals  who  were  lower  in  experience,  prior  knowledge,  and  demonstrated  ability  prior  to 
engaging  in  small  group  training.  Although  our  data  was  limited  to  a  single  Test  class,  the 
average  minimum  Go  Percent  rate  was  higher  in  the  BRITE  group  than  the  Control.  While  more 
extensive  research  and  data  is  needed  to  discern  the  scope  and  consistency  of  this  trend,  it 
appears  that  bringing  all  observing  Soldiers  together  in  a  single,  large  group  under  the  tutelage  of 
other  instructors,  allowed  instructors  to  focus  their  complete  attention  to  a  single  student  in  the 
HOT  or  on  the  equipment.  In  this  research  and  consistent  with  long-established  learning 
strategies,  lower  performing  and  less  knowledgeable  students  appeared  to  benefit  most  from  the 
greater  opportunities  for  focused,  in-depth,  individual  tutoring  created  when  an  instructor  can 
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dedicate  full  attention  to  a  single  student  rather  than  attempting  to  divide  attention  between  two 
different  subgroups. 

Recommendations 

Although  this  effort  represents  a  limited  examination  of  prior  knowledge  predictors 
tailored  to  applied  military  training  settings,  tailored  strategies  for  small  group  training  in  field 
settings,  and  the  initial  employment  of  MCT  platforms  in  technical  military  training,  its  findings 
provide  a  number  of  recommendations  for  Anny  training  units. 

Predictor  measures.  Army  training  units  considering  options  for  developing  tailored 
predictor  measures  for  their  programs  should  carefully  review  their  course  content  and  learning 
outcomes  to  identify  the  critical  basic  concepts  and  skills  that  enable  student  success  during 
training.  Based  on  our  research,  experienced  instructors  and  training  developers  have  a  good 
understanding  of  the  basic  skills  that  are  most  relevant  to  critical  learning  objectives  and  enable 
students  to  excel  in  training.  In  this  effort,  prior  mechanical  and  electrical  experience  and 
familiarization  with  vehicle  maintenance  tools  and  equipment  were  effective  predictors  of  later 
success  in  armored  vehicle  maintenance  training.  Our  research  indicates  that  this  practical 
knowledge  is  a  more  effective  basis  for  developing  appropriately  tailored  measures  for  predicting 
later  student  performance  than  GT  scores  alone,  published  standardized  instruments  or  other 
measures  of  convenience,  such  as  prior  assignment  or  deployment  history  or  APFT  scores. 

In  extensive,  complex  training  programs,  units  should  consider  tailoring  these  measures 
not  for  the  entire  course,  but  for  the  most  difficult  or  crucial  portions  of  the  course  which  they 
most  need  to  tailor  to  individual  student’s  strengths  and  weaknesses.  This  approach  will  allow 
for  more  in-depth  assessment  of  prior  knowledge  and  skills  directly  relevant  to  the  most  critical 
or  challenging  portions  of  the  course. 

Tailored  small  group  training.  One  of  the  key  recommendations  emerging  from  this 
research  is  that  units  interested  in  enhancing  their  ability  to  tailor  small  group  training  should 
seek  to  increase  the  degree  of  flexibility  given  to  instructors.  Our  research  indicated  that  the 
more  instructors  were  given  the  opportunity  to  simultaneously  multitask  groups  or  subgroups  of 
students  and  to  deviate,  within  specified  boundaries,  from  established  training  schedules,  the 
better  they  were  at  tailoring  training  to  increase  student  engagement,  meet  the  needs  of  all  their 
students,  and  to  adjust  to  unplanned  resource  constraints,  e.g.  nonavailability  of  equipment, 
equipment  failures,  and  lack  of  functional  replacements. 

BRITE.  Although  a  very  limited,  initial  assessment  of  novel  learning  technologies 
applied  to  a  field  training  setting,  our  research  indicates  BRITE,  specifically  the  employment  of  a 
MCT,  holds  a  great  deal  of  potential.  However,  this  technology  must  be  purposefully  integrated 
within  the  training  with  careful  consideration  of  its  purpose  and  relationship  to  other  ongoing 
training  activities.  Instructors  must  be  fully  trained  on  all  aspects  of  the  technology’s  operation, 
correction,  and  capabilities.  A  simple  familiarization  review  is  not  sufficient  for  instructors  to 
gain  the  expertise  and  confidence  they  needed  to  exploit  these  new  capabilities  in  their  training 
and  efforts  to  enhance  students’  learning  experiences. 
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Finally,  in  addition  to  ensuring  sufficient,  current,  preprogrammed  content  and  materials 
are  made  available  to  instructors  to  support  training  and  fulfill  the  technology’s  intended  use, 
training  content  must  be  varied  in  form  and  difficulty.  While  there  is  some  value  in  limited 
repetition  of  critical  skills  or  knowledge  concepts,  units  must  be  aware  of  how  routine  repetition 
of  basic  materials  adversely  impacts  student  engagement.  Also,  instructors  must  be  trained  on 
how  to  use  the  technology  to  individually  or  collaboratively  facilitate  training  and  student 
engagement  in  different  group  and  training  settings. 

Limitations 

Every  research  effort  has  limitations,  which  future  research  should  attempt  to  address  and 
refine.  This  research  was  admittedly  limited  in  scope  as  a  result  of  its  focus  on  Abrams  and  BFV 
maintainers’  training  and  the  number  of  available  classes  and  participants.  A  more 
comprehensive  effort  should  be  made  to  expand  the  number  and  variability  of  AIT  units 
participating  in  research  building  upon  this  foundation.  Additionally,  this  effort  provides  an 
initial  assessment  of  how  tailored  training,  student  engagement,  and  training  interactions  vary 
with  group  size  and  composition,  based  on  students’  prior  knowledge,  experience,  and  early 
demonstrated  perfonnance.  Future  efforts  should  employ  more  comprehensive  research 
strategies  to  comprehensively  assess  the  complex  interactions  and  engagement  strategies 
associated  with  the  multiple  group  training  settings  we  observed  in  this  effort. 

Due  to  the  need  to  compare  the  effectiveness  of  multiple  types  of  predictor  measures  to 
predict  later  student  perfonnance,  the  number  and  variety  of  content  related  and  unit  derived 
items  was  limited.  Future  research  should  build  upon  the  findings  of  this  effort  to  expand  our 
understanding  of  how  to  develop  and  validate  these  types  of  focused  instruments,  in  tenns  of 
targeted  knowledge  concepts  and  skills.  This  research  should  also  expand  our  understanding  of 
how  to  better  use  the  outcomes  from  these  measures  to  effectively  tailor  subsequent  training. 

As  frequently  recognized  in  this  report,  this  research  provides  a  limited  assessment  of  the 
initial  BRITE  employment  within  annored  vehicle  maintenance  training.  Consistent  with  the 
unit’s  original  plans,  additional  MCTs  have  been  subsequently  purchased  and  employed  by  the 
units  since  the  completion  of  this  initial  effort.  Future  research  should  be  conducted  to  assess  the 
impact  of  the  full  employment  of  the  matured  technology,  varied  preprogrammed  content,  and 
refined  instructor  training.  It  should  also  seek  to  expand  the  number  of  participants  to  detennine 
if  the  trends  noted  in  this  research  regarding  the  technology’s  impact  on  lower  perfonning 
students  are  statistically  significant. 
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Acronyms 


AAR 

ALC 

ALM 

AIT 

APFT 

AR 

AR  BN 

ARI 

ASVAB 

BFV 

BRITE 

CDR 

DA 

DCG-IMT 

EIM 

ETS 

GT 

HOT 

HOTT 

IMT 

MCT 

MOS 

MM 

N 

ODS 

OTD 

PE 

POI 


SD 

SEP 


After  Action  Review 

Anny  Learning  Concept 

Anny  Learning  Model 

Advanced  Individual  Training 

Anny  Physical  Fitness  Test 

Arithmetic  Reasoning  section  of  the  ASVAB 

Annor  Battalion 

U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
Anned  Services  Vocational  Aptitude  Battery 

Bradley  Fighting  Vehicle 

Blended  Rotation  Interactive  Technology  Environment 

Commander 

Department  of  the  Anny 

Deputy  Commanding  General  for  Initial  Military  Training 

Excellence  in  Maintenance 
Education  Testing  Service 

General  Technical  section  of  the  ASVAB 

Hands-on  Trainer 
Hands-on  Turret  Trainer 

Initial  Military  Training 

Mobile  Classroom  Trainer 

Military  Occupational  Specialty 

Mechanical  Maintenance  section  of  the  ASVAB 

Number  (in  sample) 

Operation  Desert  Stonn 
Ordnance  Training  Detachment 

Practical  Exercise 
Program  of  Instruction 

Pearson’s  Correlation 

Standard  Deviation 
System  Enhanced  Package 
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SME 

Subject  Matter  Expert 

SPSS 

Statistical  Package  for  the  Social  Sciences 

TMDE 

Test,  Measurement,  and  Diagnostic  Equipment 

TR 

TRADOC  Regulation 

TRADOC 

U.S.  Anny  Training  and  Doctrine  Command 

TSP 

Training  Support  Package 

VDT 

Vehicle  Digital  Trainer 

VE 

Word  Knowledge  and  Paragraph  Comprehension  sections  of  the  ASVAB 
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APPENDIX  A 

BACKGROUND  QUESTIONNAIRE 


A-l 


Purpose:  We  want  to  see  what  relevant  knowledge,  skills,  and  experiences  you  have  when 
entering  this  course.  We  fully  expect  that  Soldiers  will  differ  on  these  dimensions,  ranging  from 
much  to  little  or  none. 


Background  Questionnaire 

Name: _  Class/Date: _ 

Answer  each  of  the  following  questions  based  on  all  your  personal  experience,  civilian  and 
military,  to  date. 

1.  Based  on  your  actual  experience,  which  of  the  following  platforms  are  you  completely 
confident  in  your  ability  to  use  without  assistance?  (Circle  all  that  are  appropriate) 

(a)  desktop  computer/personal  computer  or  laptop 

(b)  smart  phone  (includes  iPhone  and  Android) 

(c)  interactive  tablets 

(d)  other  (please  specify): _ 

2.  Which  of  the  following  best  describes  your  current  expertise  with  computers  and  software 
packages?  (Check  only  one  answer.) 

(a)  _  Limited  experience  with  computers 

(b)  _  Good  with  one  type  of  software  package  (such  as  word  processing,  spreadsheet. 

Power  Point  slides) 

(c)  _  Good  with  several  software  packages 

(d)  _  Can  program  in  one  language  (e.g.,  Cobol,  Basic,  Java)  and  use  several  software 

packages 

(e)  _  Can  program  in  several  languages  and  use  several  software  packages 

(f)  _  Expert — Bill  Gates  would  hire  me 
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3.  How  often  have  you  engaged  in  routine  vehicle  maintenance  tasks  (e.g.,  changed  oil  filter, 
replaced  tires)  on  each  of  the  following  vehicle  types?  How  recently  have  you  maintained  this 
vehicle  type?  (Circle  only  one  answer  in  the  second  column.  If  you  chose  'never'  in  the  second 
column,  ignore  the  third  column  and  proceed  to  the  next  vehicle  type.) 


Vehicle  Type 

Frequency  of  Maintenance  (Circle 

One) 

1  Have  Maintained  This  Vehicle 
Type  in  The  Last: 

Typical  civilian  vehicle  (e.g., 
pickup  truck,  motorcycle,  car) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week  /  Month  /  Six  Months/ 
Longer 

Farm  equipment  (e.g.,  tractor) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week  /  Month  /  Six  Months/ 
Longer 

Construction  equipment  (e.g., 
bulldozer) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week  /  Month  /  Six  Months/ 
Longer 

Recreational  vehicle  (e.g.,  four 
wheeler) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week  /  Month  /  Six  Months/ 
Longer 

4.  How  often  have  you  engaged  in  complex  maintenance  tasks  (e.g.,  changed  transmission, 
installed  new  engine)  on  each  of  the  following  vehicle  types?  How  recently  have  you 
maintained  this  vehicle  type?  (Circle  only  one  answer  in  the  second  column.  If  you  chose 
'never'  in  the  second  column,  ignore  the  third  column  and  proceed  to  the  next  vehicle  type.) 


Vehicle  Type 

Frequency  of  Maintenance  (Circle 

One) 

1  Have  Maintained  This 
Vehicle  Type  in  The  Last: 

Typical  civilian  vehicle  (e.g.,  pickup 
truck,  car) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week/  Month  / Six  Months 
/  Longer 

Farm  equipment  (e.g.,  tractor) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week/  Month  / Six  Months 
/  Longer 

Construction  equipment  (e.g., 
bulldozer) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week/  Month  / Six  Months 
/  Longer 

Recreational  vehicle  (e.g.,  four 
wheeler) 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week/  Month  / Six  Months 
/  Longer 
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5.  How  often  have  you  engaged  in  routine  electrical  work  (e.g.,  replacing  spark  plugs,  dealt 
with  home  power  box)?  How  recently  have  you  done  such  a  task?  (Circle  only  one  answer  in 
the  second  column.  If  you  chose  'never'  in  the  second  column,  ignore  the  third  column  and 
proceed  to  the  next  electrical  task.) 


Electrical  Task 

Frequency  of  Task  (Circle  One) 

1  Have  Done  This  Task  in  the 

Last: 

Replace  spark  plugs 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week  /  Month  /  Six  Months 
/  Longer 

Dealt  with  home  power  box 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week  /  Month  /  Six  Months 
/  Longer 

6.  How  often  have  you  ever  engaged  in  complex  electrical  work  (e.g.,  replaced  an  electrical 
system  in  a  car,  solved  an  electrical  problem  using  schematic  diagrams)?  How  recently  have 
you  done  such  a  task?  (Circle  only  one  answer  in  the  second  column.  If  you  chose  'never'  in 
the  second  column,  ignore  the  third  column  and  proceed  to  the  next  electrical  task.) 


Electrical  Task 

Frequency  of  Task  (Circle  One) 

1  Have  Done  This  Task  in  the 

Last: 

Replaced  the  electrical  system,  or 
a  good  portion  of  it,  in  a  car 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week/  Month  / Six  Months 
/  Longer 

Solved  electrical  problem  using 
schematic  diagrams  [Please 
identify  source:  house,  car, 
tractor,  etc.: 

Weekly  /  Monthly  /  Less  Often  / 
Never 

Week/  Month  / Six  Months 
/  Longer 

7.  Have  you  ever  performed  a  diagnostic  test  on  a  vehicle? _ Yes  _  No 

If  yes,  please  indicate  type(s)  of  vehicle(s)  and  diagnostic  procedure(s)  in  the  space 
below: 


8.  Have  you  ever  read  a  technical  manual  to  troubleshoot  a  vehicle?  _  Yes _  No 

If  yes,  please  indicate  the  context  (e.g.,  you  worked  at  Auto  Zone). 
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We  know  that  your  knowledge  of  how  to  maintain  a  vehicle  such  as  the  Abrams  tank  or  Bradley 
Fighting  Vehicle  is  unique,  and  can  be  limited  or  extensive.  Because  learning  about  electronics 
is  a  central  part  of  this  course,  we  want  a  snapshot  of  what  you  already  know  about  this  area. 
Please  answer  the  questions  below  to  the  best  of  your  ability.  If  you  do  not  know  the  answer, 
please  mark  "Don't  know".  What  you  say  will  in  no  way  impact  your  grade  in  the  course  and 
will  not  be  shared  with  your  instructors. 

9. 


A  B 


This  circuit  has  four  ’’test  points”  labeled  with  the  letters  A,  B,  C,  and  D.  Assuming  the 
circuit  is  functioning  (light  bulb  is  energized),  determine  whether  or  not  there  will  be 
substantial  voltage  between  the  following  sets  of  points: 


•  Between 

•  Between 

•  Between 

•  Between 

•  Between 

•  Between 


and  B: 

Voltage 

No  Voltage 

Don’t  Know 

and  C: 

Voltage 

No  Voltage 

Don’t  Know 

and  D: 

Voltage 

No  Voltage 

Don’t  Know 

and  A: 

Voltage 

No  Voltage 

Don’t  Know 

and  C: 

Voltage 

No  Voltage 

Don’t  Know 

and  B: 

Voltage 

No  Voltage 

Don’t  Know 
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10.  Examine  this  schematic  diagram: 


Switch 


Light  bulb 


Battery 


Now,  without  moving  the  following  components,  show  how  they  may  be  connected 
together  with  wires  to  form  the  same  circuit  depicted  in  the  schematic  diagram  above. 

Please  draw  lines  indicating  the  wires. 


Light  bulb 


A-6 


1 1 .  Identify  the  “circuit  symbol”  with  its  corresponding  component. 


A. 


Earth  (Ground) 


B. 


Motor 


C. 


Transistor  PNP 


D. 


Diode 


E. 


Lamp  (Indicator) 


F _ rYYY\ 


Ammeter 


G. 


Voltmeter 


H. 


Ohmmeter 


I. 


Coil;  Solenoid 


STOP  NOW.  DO  NOT  PROCEED  WITHOUT  FURTHER 
INSTRUCTIONS. 


Don’t  Know 


Don’t  Know 


Don’t  Know 


Don’t  Know 


Don’t  Know 

Don’t  Know 

Don’t  Know 


Don’t  Know 


Don’t  Know 
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APPENDIX  B 

TRAINING  OBSERVATION  FORMS 
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Tailored  Training  in  Armor  Vehicle  Mnx,  IJun  12 


Part  I:  Training  Setting 


Training  Observation  Packet 


Circle:  91 A  91MCNTRL  91MBRITE 

Observer: _ 

Date: _ 


Training  Setting 

1 .  Class  #:  _  Lesson  #  and  Title: _ 

2.  Location:  (dassroom/HOTS/equipment  bay) _ 

3.  #  of  instructors: _  #  of  students: _ 

4.  (if  applicable)  #  of  workstations/operational  HOTS/vehicle  stations: _ 

5.  Briefly  describe  the  training  site  (to  include  key  training  resources/equipment). 


6.  Total  observation  period  (24hour):  _ to _ 

7.  Circle  which  of  the  following  training  events  are  planned/scheduled  for  the  training  day:  Standard  Class 

Practical  Exercise  Test  Review  Practical  Eval  Test  (academic)  Other: _ 


If  other  than  standard  classroom,  provide  general  diagram  of  site/training  area  with  emphasis  on  the  relative 
position  of  Soldiers  and  Instructors)  at  the  beginning  of  actual  training  (not  administrative  announcements  or 
activities): 
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SHEET  NUMBER: 

Date: 

Part  II:  Training  Class/Session  Observations  _(use  for  all  intact  small  groups  (i.e.  instr  working  with  entire  or  3-5  of  small  group)  and  larger  content  related  interactions  only) 


Training  Group  Size  (TGS)  |  EC  -  entire  class  |  HC  -  half  of  class  |  LG  -  large  group  (app  6-10;  less  than  'A  class)  |  SG-  small  group  (3-5)  | 


Instruction  Code  (InstrC) 

D1  -  demonstration 

D2  -  guided  demo 

GD  -  guided  discussion 

Ot  -  Other; 

BRK  (min)  -  break  (duration) 

RC  -  review/reinforce  content 

LI  -  lecture 

ID  -  informal  discussion 

PS  -  problem  solving 

ETD-endoftngday 

Trainer/Instructor  Interaction  Codes: 

E  -  Provides  additional  examples 

Student  Interaction  Codes  (focus  on  your  assigned  small  group  of  Soldiers): 

A  -  Asks  question 

C  -  Reviews  previous/related 
content 

A  -  Asks  question 

H  -  Accepts  help/support  from 
peer(s) 

P  -  Provides  feedback  on  action/performance 

L  -  Designates  a  task  or  group 
leader 

Q  -Answers  or  responds  to  a  question 

T  -  Completes/attempts  a  directed 
task 

R  -  Restates  or  refocuses  the 
question/problem 

T  -  Directs  a  task 

L  -  Takes  leadership  role  or  initiative  (w/o  being 
directed) 

Ot  -  Other 

S  -  Directly  answers  the  student’s  question 

Ot- Other 

0  -  Offers/provides  help  or  support  to  peer(s) 

Identify  the  number  of  tines  each  type  of  content  related  interaction  behavior  occurs  by  adding  a  'imple  mark  by  the  appropriate  interaction  code  each  time  it  is  observed.  These  marks  will  be  talked  at  the 
end  of  the  day  for  data  entry.  Also  add  a  similar  mark  to  indicate  each  time  a  small  group  member  initiated  the  interaction  with  their  peers  or  instructor. _ _ 


TGS 

Time 

(24Hf) 

(Mote  time 

directed 

TGS 

changed) 

InstrC  (Coded  list  of 
oO served  instruction 
activities  Enter  sense 
on  separate  line  for 
eacn  directed  chanoe 

Trainer 

Student  # 

Initiated  Interaction: 

Student  # 

Initiated  Interaction: 

Student  # 

Initiated  Interaction: 

Student  # 

Initiated  Interaction: 

in  TGS.) 

ALL 

Trainer 

Student 

Trainer 

Student 

Trainer 

Student 

Trainer 

Student 

A 

A 

A 

A 

A 

A 

A 

A 

A 

P 

P 

Q 

P 

Q 

P 

Q 

P 

Q 

R 

R 

L 

R 

L 

R 

L 

R 

L 

S 

S 

O 

S 

O 

S 

O 

S 

O 

E 

E 

H 

E 

H 

E 

H 

E 

H 

C 

C 

T 

C 

T 

C 

T 

C 

T 

L 

L 

Ot 

L 

Ot 

L 

Ot 

L 

Ot 

T 

T 

T 

T 

T 

Ot 

Ot 

Ot 

Ot 

Ot 

A 

A 

A 

A 

A 

A 

A 

A 

A 

P 

P 

Q 

P 

Q 

P 

Q 

P 

Q 

R 

R 

L 

R 

L 

R 

L 

R 

L 

S 

S 

O 

S 

O 

S 

O 

S 

O 

E 

E 

H 

E 

H 

E 

H 

E 

H 

C 

C 

T 

C 

T 

C 

T 

C 

T 

L 

L 

Ot 

L 

Ot 

L 

Ot 

L 

Ot 

T 

T 

T 

T 

T 

Ot 

Ot 

Ot 

Ot 

Ot 
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Tailored  Training  in  Armor  Vehicle  Mnx,  IJun  12 


SHEET  NUMBER: 

Observer 

Date: 

Part  II:  Training  Class/Session  Observations  .(use  for  all  intact  small  groups  (i.e.  instr  worivng  with  entire  or  3-5  of  small  group)  and  larger,  content  related  interactions  only) 


Training  Group  Size  (TGS)  |  EC  -  entire  class  |  HC- half  of  class  |  LG  -  large  group  lapp  6- 10:  less  than  '/;  class)  |  SG- small  group  (3-5)  | 


Instruction  Code  (InstrC) 

D1  -  demonstration 

D2  -  guided  demo 

GD  -  guided  discussion 

Ot- Other 

BRK  (min)  -  break  (duration) 

RC  -  review/reinforce  content 

LI  -  lecture 

ID  -  informal  discussion 

PS  -  problem  solving 

ETD-endoftngday 

Trainer  instructor  Interaction  Codes: 

E  -  Provides  additional  examples 

Student  Interaction  Codes  (focus  on  your  assigned  small  group  of  Soldiers): 

A  -  Asks  question 

C  -  Reviews  previous/related 
content 

A  -  Asks  question 

H  -  Accepts  help/support  from 
peerts) 

P  -  Provides  feedback  on  action/performance 

L  -  Designates  a  task  or  group 
leader 

Q  -Answers  or  responds  to  a  question 

T  -  Completes/attempts  a  directed 
task 

R  -  Restates  or  refocuses  the 
question/problem 

T  -  Directs  a  task 

L  -  Takes  leadership  role  or  initiative  (w/o  being 
directed) 

Ot  -  Other 

S  -  Directly  answers  the  student’s  question 

Ot- Other 

0  -  Offers/provides  help  or  support  to  peer(s) 

Identify  the  number  of  time:  each  type  of  content  related  interaction  behavior  occurs  by  addin*  a  simple  mark  by  the  appropriate  interaction  code  each  time  it  is  observed.  These  marks  will  be  talked  at  the 
end  of  the  dav  for  data  entry.  Also  add  a  similar  mark  to  indicate  each  time  a  small  gronp  member  initiated  the  interaction  with  their  peers  or  instructor. _ _ 


TGS 

Time 

(24tv) 

Mote  time 

directed 

TGS 

changed) 

InstrC  (Coded  list  or 
observed  Instruction 
activities  Enter  senes 
on  separate  line  Tor 
each  directed  change 
in  TGS.) 

Trainer 

Student  # 

Initiated  Interaction: 

Student  # 

Initiated  Interaction: 

Student  # 

Initiated  Interaction: 

Student  # 

Initiated  Interaction: 

ALL 

Trainer 

Student 

Trainer 

Student 

Trainer 

Student 

Trainer 

Student 

A 

A 

A 

A 

A 

A 

A 

A 

A 

P 

P 

Q 

P 

Q 
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Tailored  Training  in  Armor  Vehicle  Mnx,  IJun  12 


SHEET  NUMBER: 

Date: 

Part  lla:  Divided  Small  Group  Observations  (use  for  all  divided  small  groups  (i.e.  Instr  working  with  1  to  2  students  with  others  observing);  content  related  interactions  only) 


Instruction  Code  (InstrC) 

D1  -  demonstration 

D2  -  guided  demo 

GD  -  guided  discussion 

Ot- Other: 

BRK  {min)  -  break  (duration) 

RC  -  review/reinforce  content 

LI  -  lecture 

ID  -  informal  discussion 

PS  -  problem  solving 

ETD  -  end  of  tng  day 

Trainer/Instructor  Interaction  Codes: 

C  -  Reviews  previous/related  content 

Observing  Student  Interaction  Codes  (focus  only  on  content  based  interactions): 

A  -  Asks  question 

L  -  Designates  a  task  or  group  leader 

A  -  Asks  instructor  a  question 

Q  -Answers  or  responds  to  instr  question 

H  -  Highlights  points  from  focal  group  tng 
scenario  and  actions 

D  -  Designates  a  peer  instructor 

L  -  Takes  leadership  role  or  initiative 
(w/o  beinq  directed) 

T  -  Completes/attempts  a  directed  task 

T  -  Directs  a  task  or  provides  a  problem  to  be 
solved 

B  -  Control  behavior,  refocus  attention  on 
tng  content/event 

0  -  Offers/provides  help  or  support  to 
peer(s) 

Ot  -  Other  (specify) 

S  -  Directly  answers  an  observing  student’s 
question 

Ot- Other 

H  -  Accepts  help/support  from  peer(s) 

Identify  the  number  of  time'-  each  type  of  content  related  interaction  behavior  occurs  by  adding  a  simple  mark  by  the  appropnate  interaction  code  each  time  it  is  observed.  These  marks  will  be  tallied  at  the 
end  of  the  day  for  data  entry.  Due  to  the  need  to  attend  to  2  subgroups  at  the  same  time,  focus  on  changes  in  the  instructional  strategy  by  the  instructor  with  the  focal  training  students)  and  interactions  with 
the  observing  students.  The  Trainer. Instructor  Codes  have  been  slightly  altered  from  Part  II  to  reflect  the  most  overt  interactions  expected  in  this  unique  training  setting  and  reduce  the  noise  generated  by  a 
significantly  increased  volume  of  instructor-student  interactions  in  the  focal  training  subset  and  student-student  interactioos  in  the  observing  subset  that  is  inherit  with  this  setting. _ 


Student 
*  in  1-1 
or  1-2 
tng 

w/lnstr 

Time 

(24b  r) 

(Note 
time  focal 
student(s) 
change) 

Trainer  Instruction 
w/Focal 

Student/Pair 

Trainer 

Interaction  with 

Remaining/Observing 

Students 

Student  # 

Student  # 

Student  # 

Student  # 

ALL  Observ  ng  Stjdents 

Trainer 

Student 

Trainer 

Student 

Trainer 

Stueert 

Trainer 

Student 

01 

A 

A 

A 
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A 

A 

A 
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H 
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Tailored  Training  in  Armor  Vehicle  Mnx,  IJun  12 
Part  III:  Practical  Evaluation  Observations 


SHEET  NUMBER: 

Observer _ 

Date: _ 


Evaluation  Topic/Task: _  Were  all  Soldiers  presented  the  same  evaluation  scenario/task?  (circle  one)  Yes  No  If 

different,  please  briefly  describe  how  they  differed: _ 


Trainer/Instructor  Role<s): 

Peer  coaching  or 
instruction  observed? 

Identfy  frequency  each  of  the 

following  roles  are  observed: 

Q  •  Answers  Questions 

Yes-No 

C  -  Reviews  Content 

If  yes.  then  identify  obs  of 

P  -  Provides  Feedback 

P  - 1  on  1  (pair) 

Time 

1  -  Provaes  Instruction 

G  -  Small  Group  i'3-5) 

0  -  Observe  Soldiers 

Ol -Other 

Observaton 

{passive  presence:  non  eval) 

Narrative  Observations/Descriptions/Comments  (including  specific  topics),  if  any. 

Start-stop 

(24hr) 

Obs  Setting 

Of -Other 

reviewed  in  PreEval  and  Post  Eval  sessions): 

Q 

PreEval  Review, 'Prep  Area 

C 

P 

#  Instructors  Present: 

P 

G 

1 

Ot 

0 

Ot 

Post  Eval  Area 

Q 

P 

C 

#  Instructors  Present 

P 

G 

If  tng  conducted,  identfy  tope  & 
describe  content  n  comments  Also, 
describe  tng  setting. 

0 

Ot 

Ot 

Q 

Post  Eval  Rev  ew  AAR 

C 

P 

#  Instructors  Present 

P 

G 

Session  conducted  {circle  one): 

1 

0 

Ot 

1-1  with  primary  small  group  nstr 

Ot 

In  small  group  wth  primary  small 
group  nstr 

Other  (specify): 

B-6 


Tailored  Training  in  Armor  Vehicle  Mnx,  IJun  12 


SHEET  NUMBER: _ 

Observer _ 

Date: _ 

Part  IV:  Overall  Conclusions  and  Assessment/Final  Notes 

Complete  this  part  at  the  end  of  the  day’s  observations  by  reflecting  upon  the  entire  training  day  and  across  all 
observed  individual  or  group  activities  and  training  interactions. 


Q# 


Observation 


12  3  4 


Soldier/Soldier  training  interactions  were  most  often: 

1  -  Directed  by  the  instructor 

2  -  Initiated  by  the  Soldiers 
4  -  Not  Observed 


4a 


Soldier/instructor  training  interactions  were  most  often: 

1  -  Initiated  by  the  instructor 

2  -  Initiated  by  the  Soldiers 
4  -  Not  Observed 


In  4a  through  4f  rate  the  frequency  you  observed  the  identified  types  of  tailored 
training  strategies  using  the  following  scale: 

1  -  Seldom/Rarely,  2  -  Sometimes,  3  -  Regularly,  4  -  Not  observed 


Scaffolding  (instructor  enables  the  student  to  master  a  task  or  concept  that  the  student  is  initially 
unable  to  grasp  on  their  own  by  temporarily  modeling  or  providing  prompts,  cues,  and  feedback  on 
those  skills  or  steps  that  are  currently  beyond  the  student's  demonstrated  capability.  Once  the  student 
begins  to  show  they  can  accomplish  the  steps  or  task,  the  instructor  withdraws  their  help  (often 
referred  to  as  ‘fading"  or  removing  the  scaffolding)  to  allow  the  student  to  proceed  on  their  own.) 


4b 


Backwards  Fading  (instructor  provides  a  complete  demonstration  of  the  task  or  procedure, 
followed  by  a  progressive  reduction  of  instructor  guidance  and  an  increasingly  autonomous  role  by  the 
student  in  subsequent  repetitions  of  the  task.) 


4c 


Didactic  /  Lecture  (instructor  provides  information  with  little  to  no  opportunity  for 
student/instructor  interaction  or  discussion  beyond  the  clarification  of  presented  facts  or  points.) 


4d 


Comprehension  Gauging  (instructor  confirms  students  are  attending  to  and  following  the 
presented  content;  may  or  may  not  involve  a  brief  knowledge  check  of  recent  content) 


4e 


Simple  (Yes  /  No)  (  simple  and  direct  assessment  of  or  reaction  to  the  accuracy  of  a  student's 
answer,  explanation,  statement,  etc.,  with  no  further  elaboration) 


4f 


Other  (specify): 


5a 


6a 


Did  the  instructors  direct  individual  Soldiers  to  assume  specific  roles  within  the 
group  (e  g.,  peer  instructor,  group  leader,  etc.)? 

1- Yes 

2- No 


If  the  answer  to  question  5  is  yes,  what  roles  were  directed? 


5b 


If  yes  to  (5),  on  what  basis  were  the  Soldiers  chosen  for  these  roles  (if  discernible): 


What,  if  any,  impact  did  these  roles  have  on  Soldier  behavior  and  interaction  (if 
none,  so  indicate)?  _ 


Were  there  occasions  in  which  Soldiers  observed  other  Soldiers  perform  a  task 
while  assembled  in  their  intact  small  group  or  larger  groups? 

1- Yes 

2- No 


If  the  answer  to  question  6  is  yes,  approximately  how  many  times  was  this 
observed? _ 
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Tailored  Training  in  Armor  Vehicle  Mnx,  IJun  12 


Q# 

Observation 

1 

2 

3 

4 

7 

To  what  extent  did  the  Soldiers  appear  passive  and  inattentive  to  the  team’s 
actions  or  class  activities?  (includes  social  loafing,  nonparticipation  or  lack  of  overt 
engagement  in  training  activities,  etc.) 

1  -  Seldom/Rarely,  2  -  Sometimes,  3  -  Regularly,  4  -  Not  observed 

: 

: 

8 

Were  Soldiers  observed  coming  together  as  a  group  or  in  pairs  to  work  on  a  task 

or  review  covered  material  without  being  directed  to  do  so  bv  the  instructor? 

1- Yes 

2- No 

8a 

If  yes  to  item  8,  rate  the  frequency  Soldiers  were  observed  working  together  in 
groups/pairs  using  the  following  scale: 

1  -  Seldom/Rarely,  2  -  Sometimes,  3  -  Regularly,  4  -  Not  observed 

9 

Rate  the  overall  level  of  Soldier  engagement  during  the  day's  training  using  the 
following  scale: 

1  -  Low  (Passively  received  instruction) 

2  -  Average 

3  -  High  (Consistently  and  actively  engaged  in  all  training  events/activities) 

4  -  Not  observed 

10 

Overall,  reflecting  upon  the  day's  training,  the  instructor's  comments  and 
feedback  focused  on  the  Soldiers'  (check  all  observed  categories  ): 

1  -  Comprehension  of  Material 

2  -  Task  Performance 

3  -  Attention  to  Ongoing  Training  Event 

4  -  Active  Participation  in  Training  Event 

5  -  Conduct/Discipline  Issues  (during  training) 

6  -  Overall  Course  Progress 

7  -  Sequence  of  Training  Activities 

8  -  Nontraining  Issues  (e  g.  external  conduct,  quality  of  life) 

10a 

Of  the  categories  checked  in  item  10  above,  circle  the  ONE  that  reflects  the 
dominate/primary/most  frequently  observed  focus  of  the  instructor's  comments 
and  feedback  throughout  the  day. 

11 

BRITE  class  only!  In  11a  through  lie,  rate  the  frequency  each  of  the  following 

BRITE  training  options  was  used  during  the  training  day  using  the  following  scale: 

1  -  Seldom/Rarely,  2  -  Sometimes,  3  -  Regularly,  4  -  Not  observed 

11a 

Live  feed  instruction  demonstration  or  guided  demonstration 

lib 

Live  feed  one-on-one  or  one-on-two  training 

11c 

Training  presentation  (on  task) 

lid 

Current  Training  presentation  (specify  topic(s)) 

lie 

Other  (specify) 
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Q# 

Observation 

12 

BRITE  class  only!  Describe  the  impact  the  technology  had  on  the  observed 
training  and  identify  any  issues  that  emerged  with  its  use  (continue  on  separate 
page  if  needed). 

Provide  any  additional  comments,  observations,  or  clarifications  regarding  the  day's  training  events: 
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APPENDIX  C 

TRAINING  CONFIGURATIONS 


C-l 


91 A  HULL  TRAINING 


UsedFotm2-  Urge  Grow  c*  *  Entire fliU  xSmanboard  or  in 
computer  lab  with  multiple  observers  -  (eg  Watching  movies  on 
laptops  or  Smartboa*d  or  naming  with  the  desk  top  tiamef/vdti 
Also  done  for  lectures  with  Class  OS.  Turet  Very  few  data  entries 


'teP1  □  ; 


Tables  and  Power  Student  Instructor 

Chairs  Pac 


NOTE:  Power  Pac  may  be  live  engine  dead  engine  in  the  tank.  or  dismounted  from  the  tank  and 
connected  by  a  Ground  Op  Kit. 


Example  6  1 


Example  1 


• 

2* 

3* 

V - 

ft 

Used  Form  2-  Discussion 
or  training  irwotvlng  all 
students-  (eg  introducing 
new  skills,  drawing 
schematics) 

1  Some  data  entries  made 


Example  2 


□ 


■CM)' 


•UsedForm2-  Hands  on 
training  involving  all 
students  on  two  to  three 
simultaneous  tasks- (eg 
Transmissions.  NBC  system, 
fire  system? 

•  Most  data  entries  made 


•  Used  For  m2  •  Hands  on 
training  involving  all 
students  on  a  single  task- 
leg  Changing  atorsion  bar 
or  installing  engine? 

•  Some  data  entries  made 


Example  4 


training  involving  one  or 
two  student  w Me  other 
students  observed  -  (eg 
Pepainng  a  fuel  iniector? 

1  Some  data  entries  made 


Example  5 


27  ~ 


■  UsedForm2a-  Hands  on 
training  involving  one  or 
two  students  •  Other 
students  given  other  tasks 
-(eg  Look  up  part 
numbers'* 

•  Fewer  data  entries  made 


Figure  C-l.  91 A  hull  training  layout. 


91 A  TURRET  TRAINING 


=i 

ft 

r—  Mobile  Classroom 

1  l63)  1  T,an*f  Smartboard 

Moble  TaMtsjmd  •  SMu* 

Abrams  Hands-on- 
Trainer  (HOT) 

Abrams 

Component  Chairs  *  Instructor 

Simulator  •  Observer 

NOTE:  BRITE  technologies  observed  with  ENI 
Group  ONLY  during  turret  training,  Class  07. 


Example  1  Example  2 


Example  3 


i^or 

h\| 

M 

i^OzO*4* 

•2 

• 

•Used Form 2-  Oiscussicn 
or  training  involving  all 
students-  (eg  reviewing, 
discussing  troubleshooting 
procedures? 

•  Many  data  entries  made 


•  Used  For  m2  ■  Hands  on 
trailing  involving  one  or 
two  students  while  other 
students  observed  -  (eg 
Tracing  wiringfaults). 
May  involved  a  HOT , 
siimiatOf.OTtark 

•  Some  data  entries  made 


•UsedFocm2a-  Hands  on 
training  irwoiving  one  or 
two  students  -  Other 
students  given  ether  tasks 
-(eg  Review  procedures 
or  perform  ether  tasks'? 
May  involve  atari  . 
simiJator.  or  HOT. 

•  Few  data  entries  made 


training  involving  all 
students  on  two  or  three 
simultaneous  tasks,  may  be 
split  between  HOT  and  a 
tank- (eg  Turret 
h,<* allies,  fire  control, 
sight  praging? 

■  Some  data  entries  mode 


Example  5  * 


training  involving  one  or 
two  students  -Other 
students  in  Small  Group  at 
Smartboardlrwohed  in 
independently  directed 
other  tasks-  (eg  Watch 
videos,  trace  schematics . 
workbook  completion,  or 
watch  live  view  of  helmet 
camera  onSmartboard? 

■  Very  few  to  no  data  entries 
mode 


Example  6  * 


■  Used  F  erm  2  -  Discussions, 
demonstrations,  or  video 
training  involving  all 
students.  Smart  board 
display  sometimes  usedto 
facilitate  trainingi  -  (eg 
Watch  videos,  observe 
images,  or  trace 
schematics! 

■  Many  data  entries  made 


Figure  C-2.  91 A  turret  training  layout. 
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91 M  HULL  TRAINING 


• 

£ 

y 

Observer 

°  .  . 

zzzz 

Tables  and 

Power  Student  Instructor 

—  —  — 

Bradley 

Chairs 

Pac 

Smart  board 

Example  1 


Example  5 


•  Used  Form  2  ■  Discussion 
or  naming  involving  all 
students  -  (e  g  rfcawing 
schematics) 

•  Happened  20%  ol  the  time 

•  Many  data  entiles  made 


Example  2 


Example  3 


■  Used  Form  2  -  Hands  on 
training  involving  all 
students-  (e  g  Changing  a 
torsion  bar  or  installing 
engine) 

•  Happened  15%  ol  the  time 

•  Some  data  entries  made 


•  Used  For  m2  -  Hands  on 
training  involving  one 
student  while  other 
students  observed  -  leg 
Repairing  afuel  injector) 

•  Happened  50*0  o I  the  time 

•  Some  data  entries  made 


Example  4 


•  Used  Form  2a-  Hands  on 
training  involving  one 
student  -  Other  students 
given  other  tasks  -  (eg 
Look  up  part  numbers) 

•  Happened  10%  of  the  time 
•Few data  entries  made 


•UsedForm2-  Handson 
training  involving  one  or 
two  students  -  Other 
students  in  Large  Prow  or 
Half  Class  at  S  m  art  board 
with  multiple  observers  - 
(eg  Trace  schematics  on 
Smart  board) 

•  Happened  5%  of  the  time 

•  Very  few  to  no  data  entries 
made 


Figure  C-3.  91M  hull  training  layout. 


91 M  TURRET  TRAINING 


Hanc 

B 

Is- on-Tramer 

j  |  ||  Observer 

--  •  •  — 

Tables  and  Student  Instructor  «■*  w 

(HOT)  Chairs  Smartboard 

Example  1 

Example  2  Example  3 

Used  Form  2  -  Discussion 
or  training  involving  all 
students-  (eg  reviewing 
troubleshooting 
procedures) 

Happened  15%  of  the  time 
Many  data  entries  made 


•Used Form 2-  Handson 
training  involving  one  or 
two  students  wMe  other 
students  observed  -  (eg 
Tracing  wiringfaiits) 

•  Happened  60%  of  the  time 

•  Some  data  entries  made 


Used  Form  2a-  Handson 
training  involving  one 
student-  Other  students 
given  other  tasks -(eg 
Review  procedures* 

1  Happened  5%  of  the  time 
1  Few  data  entries  made 


Example  4 


•UsedForm2-  Handson 
training  involving  one  or 
two  students  -  Other 
students  in 

H  alf  Class  atSmartboard 
with  multiple  observers  - 
<e  g  Trace  schematics  or 
watch  live  view  of  helmet 
camera  onSmartboardi 

•  Happened  20%  of  the  time 

•  Very  few  to  no  data  entries 
made 


Figure  C-4.  91M  turret  training  layout. 
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Figure  C-5.  M1A2  Abrams  SEP  Hands-on  Trainer  (HOT). 


Figure  C-6.  M2A1/M3A1  BFV  Hands-on  Trainer  (HOT). 
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APPENDIX  D 

FOCUS  GROUP  INTERVIEW  PROTOCOLS 
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Tailored  Training  in  Vehicle  Maintenance  Course 
SOLDIER’S  FOCUS  GROUP  PROTOCOL 


Circle:  91 A  91M-Control  91M-BRITE 

Course  #  /  Group: _ 

Facilitator:  _ 

Date: _ 


INSTRUCTIONS  FOR  FACILITATOR/INTERVIEWER 

•  Introduce  the  session  (see  below)  including  its  role  in  this  assessment  of  tailored 
training  (and  BRITE  technology  if  applicable). 

•  Ensure  careful  notes  are  taken,  preferably  by  a  team  member  when  available. 

•  Dialogue  with  the  participants  using  the  questions  that  begin  on  the  next  page  as  a 
guide  ensuring  the  questions  shown  in  bold  are  covered  adequately  and  the  remaining 
questions  asked  as  time  permits. 

•  Adjust  to  the  group's  interests  and  strengths:  follow  up  their  comments,  pursue 
detail  if  something's  especially  important  to  a  participant. 

•  Keep  an  eye  on  the  clock  so  you  can  stay  on  schedule  (Ihr  session). 

•  Ensure  no  instructors  or  anyone  in  the  Soldiers’  chain  of  command  is  in  the  room 

during  the  interviews. _ 


INTRODUCTION  OUTLINE 

•  This  focus  group  is  a  part  of  an  ARI  research  effort  examining  tailored  training  in 
vehicle  maintenance  advanced  individual  training  (AIT)  courses,  as  well  as  assessing  the 
impact  of  BRITE  on  91 M  training. 

•  Focus  group  goal  =  provide  additional  insights  to  clarify  the  frequency  and  impact  of 
tailored  training  in  the  development  and  training  of  Army  maintenance  professionals. 

•  Focus  group  method  =  collaborative  brainstorming  +  story  telling.  Everyone 
contributes. 

•  Scheduled  topics  =  flexible.  Your  issues/concerns  are  important,  too. 

•  Your  comments  =  confidential.  We  will  protect  your  anonymity  and  privacy  as 
described  in  the  informed  consent.  We  also  expect  everyone  to  respect  the  opinions 
offered  during  this  session  and  to  ensure  any  comments  or  opinions  provided  during  this 
session  remain  confidential. 

»  Any  questions  before  we  start? _ 
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FOCUS  GROUP  QUESTIONS 


Small  Group  Experience 


1.  Did  the  instruction  provide  for  adequate  one-on-one  time  with  the 
instructor? 

2.  Were  your  individual  questions  or  training  needs  consistently  addressed  in 
a  timely  manner  during  training?  If  not,  then  why  not? 

3.  Did  the  instruction  provide  for  adequate  practice  and  practical  application 
time  performing  the  new  skills  or  applying  newly  learned  knowledge? 

4.  What  did  you  rely  upon  MOST  during  the  course  to  answer  any  questions 
you  had  or  to  overcome  any  problems  you  experienced  with  the  course  content? 

5.  Reflect  for  a  moment  on  the  times  you  were  in  small  groups  (4-5  Soldiers) 
during  training  and  answer  the  following: 

o  To  what  degree  did  everyone  seem  to  have  an  opportunity  to  take  a 
leadership  role? 

o  While  waiting  your  turn  during  a  training  session,  how  did  you  spend 
your  time  and  energy. ..passively  observing  the  training,  paying  very 
close  attention  to  the  training,  discussing  points  observed  in  the 
training  with  other  group  members,  talking  with  other  group 
members  on  topics  other  than  the  task  at  hand,  or  simply  trying  to 
stay  awake? 

o  During  the  sessions  you  just  discussed,  what  could  have  been  done 
to  increase  the  degree  to  which  you  were  actively  engaged  either 
individually  or  as  a  group  in  the  training  at  hand? 

6.  What  training  techniques  did  your  trainers  use  that  really  seemed  to  help 
you  learn? 

7.  Did  the  instructional  support  you  received  consistently  increase  your  confidence 
and  competency  in  the  skills  trained?  Consider  any  counseling,  coaching,  mentoring, 
testing  and  feedback  you  received  during  training. 

8.  Were  there  any  particular  exercises  or  training  activities  that  seemed  to  benefit 
you  the  most?  How  about,  the  least? 
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Course  Content 


Answer  questions  9  through  12  regarding  the  training  you  received  on  the 
following  systems: 

•  Hull 

•  Pack  (engine  and  transmission) 

•  Hydraulics 

•  Electrical 

9.  Which  blocks  of  training  or  subjects  were  the  most  difficult  for  you?  Why? 

10.  Which  blocks  of  training  or  subjects  were  the  easiest  for  you?  Why? 

11.  On  the  whole,  how  confident  do  you  feel  that  the  course  prepared  you  with 
the  knowledge,  skills,  and  attributes  important  for  your  duties  as  an  Abrams 
Tank/  Bradley  Fighting  Vehicle  maintainer? 

12.  Which  blocks  of  training  were  most  interesting  or  enjoyable  for  you?  What  made 
them  more  enjoyable  as  opposed  to  other  blocks? 

13.  Which  blocks  of  training  were  least  interesting  or  enjoyable  for  you?  What  made 
them  less  enjoyable  as  opposed  to  other  blocks? 

14.  Which  training  aids  or  simulators  best  helped  you  leam  or  strengthen  your 
confidence  in  your  maintenance  skills?  Describe  them. 

15.  How  did  these  training  aids  or  simulators  help  you  leam? 


•  Turret 

•  Fire  Control  System 

•  Armament 


BRITE  Technology  (91 M  BRITE  Students  Only) 


16.  What  did  you  think  of  the  Smartboard  when  used  with  or  without  the 
camera? 

17.  Did  the  Smartboard  help  you  learn?  If  so,  how? 

18.  How  did  the  instructor  most  often  use  the  technology:  to  demonstrate  new 
procedures,  to  allow  you  to  observe  other  Soldiers  during  training,  to  test  your 
knowledge,  or  to  reinforce  previously  covered  material?  Were  there  any  other 
ways  the  instructor  used  the  technology  during  your  training?  Please  describe. 

19.  How  else  could  the  BRITE  technology  best  be  utilized  during  the  course  to 
help  you  become  more  proficient? 


D-4 


Recommendations 


20. (91M  BRITE  only)  Should  the  unit  continue  to  use  the  BRITE  technology 
during  future  classes?  Why  or  why  not? 

21.  Which  blocks  of  training  or  lessons,  if  any,  should  receive  more  training  time? 

22.  Which  blocks  of  training  or  lessons,  if  any,  should  receive  less  training  time? 

End  of  Questions 
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Tailored  Training  in  Vehicle  Maintenance  Courses 
TRAINER'S/INSTRUCTOR"S  INTERVIEW  PROTOCOL 


Circle:  91 A  91M-Control  91M-BRITE 

Course  #  /  Group: _ 

Facilitator:  _ 

Date: _ 


INSTRUCTIONS  FOR  FACILITATOR 

•  Introduce  the  session  (see  below)  including  its  role  in  this  assessment  of  tailored  training 
(and  BRITE  technology  if  applicable). 

•  Ensure  careful  notes  are  taken,  preferably  by  a  team  member  when  available. 

•  Dialogue  with  the  participants  using  the  questions  that  begin  on  the  next  page  as  a  guide 
ensuring  the  questions  shown  in  bold  are  covered  adequately  and  the  remaining 
questions  asked  as  time  permits. 

•  Keep  an  eye  on  the  clock  so  you  can  stay  on  schedule  (Ihr  session). 

•  Ensure  no  other  instructors,  students,  or  anyone  in  the  participant's  chain  of  command  is 
in  the  room  during  the  interviews. 


INTRODUCTION  OUTLINE 

•  This  trainer  interview  is  a  part  of  an  ARI  research  effort  examining  tailored  training  in 
vehicle  maintenance  advanced  individual  training  (AIT)  courses,  as  well  as  assessing  the 
impact  of  BRITE  on  91 M  training. 

•  Trainer  interview  goal  =  provide  additional  insights  to  clarify  the  frequency  and  impact  of 
tailored  training  in  AIT  and  its  impact  on  operational  excellence  and  the  development  of 
trained  maintenance  professionals. 

•  Scheduled  topics  =  flexible.  Your  issues/concerns  are  important,  too. 

•  Your  comments  =  confidential.  We  will  protect  the  anonymity  and  confidentiality  of  your 
comments  as  described  in  the  informed  consent. 

•  Any  questions  before  we  start? 
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TRAINER  INTERVIEW  QUESTIONS 


Small  Group  Process 


1.  What  part  did  you  play  in  the  selection  of  the  Soldiers  for  each  small  group? 

o  Exactly  what  criteria  were  used  to  divide  the  Soldiers  into  the  small 
groups? 

2.  Was  the  number  of  high  and  low  performing  Soldiers  balanced  in  each  group?  If 
not,  why  not? 

3.  How  would  you  adjust  the  selection  process,  if  at  all? 


Tailored  Training 


4.  Within  your  primary  small  group,  how  did  you  identify  the  Soldiers  that 
needed  additional  attention  during  training? 

5.  When  you  identified  these  Soldiers,  how  did  you  tailor  or  adapt  training  to 
ensure  they  understood  the  subject?  How  did  you  track  their  subsequent 
performance/progress? 

6.  What  training  techniques  did  you  use  that  really  seemed  to  help  your 
students  learn?  Were  there  any  particular  exercises  or  training  activities  that 
seemed  to  benefit  them  the  most? 


7.  Which  blocks  of  training  were  the  most  challenging  or  difficult  for  students 
to  learn  or  comprehend?  Why? 

8.  In  relation  to  the  small  groups  (4-5  Soldiers)  used  during  training,  answer  the 
following  questions: 

o  While  waiting  their  turn  during  a  training  session,  how  did  Soldiers 
spend  their  time  and  energy. ..passively  observing  the  training, 
paying  very  close  attention  to  the  training,  discussing  points 
observed  in  the  training  with  other  group  members,  talking  with 
other  group  members  on  topics  other  than  the  task  at  hand,  or 
simply  trying  to  stay  awake? 

o  During  the  training  sessions  just  discussed,  what  else  could  have 
been  done  to  increase  the  degree  to  which  Soldiers  were  actively 
engaged  either  individually  or  as  a  group  in  the  training  at  hand? 

o  To  what  degree  did  each  student  seem  to  have  an  opportunity  to  take  a 
leadership  role  during  training? 

9.  Without  identifying  any  specific  Soldier,  did  any  of  your  students  have  any 
unique  issues  (e.g.  previously  diagnosed  learning  problems  like  ADHD  or 
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dyslexia.  ESL  or  other  language  problems,  reading  problems,  etc.)  that 
hindered  their  ability  to  learn  or  keep  pace  with  the  training?  If  so.  how  were 
you  able  to  identify  the  problem  and  address  these  unique  issues  during 
training? 

10.  Which  blocks  of  training  were  the  most  challenging  or  difficult  for  you  to  instruct? 

Why? 


BRITE  Technology 


11.  How  did  you  use  the  following  technologies  during  training? 

o  The  Mobile  Classroom  Trainer? 
o  The  Desktop  Trainer? 
o  Other  technical  training  aids? 

12.  Comparing  the  BRITE  class  to  your  experience  with  previous  classes,  did  you 
notice  any  impact  the  new  technology  had  in  the  Soldiers'  ability  to  learn  and 
perform? 

13.  Where  did  the  BRITE  technology  seem  to  be  most  effective  during  training? 

14.  Where  did  the  BRITE  technology  seem  to  be  least  effective  during  training? 

15.  How  would  you  improve  the  use  of  the  BRITE  technology  within  the  POI? 

16.  What,  if  any.  changes  to  the  BRITE  technology  and  its  capabilities  would  you 
recommend  as  result  of  your  experiences? 


Excellence  in  Maintenance  (EIM)  Group 


17.  Have  you  instructed  both  standard  small  groups  and  EIM  small  groups  in  the  past? 

18.  (If  the  instructor  has  experience  with  both  groups)  Compare  the  differences  in 
instructing  both  groups.  Consider: 

•  Speed  of  learning  •  Soldier  attentiveness 

•  Soldier  preparation  •  Subject  comprehension 

•  Time  on  task  •  Soldier  performance 

1 9.  How  did  your  interaction  with  the  EIM  Soldiers  differ  from  your  interactions  with 

other  small  groups? 
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APPENDIX  E 
RESULTS/TABLES 
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Table  E-l. 

Historical  Versus  Participating  Course  Comparisons 


Abrams 

Variable 

Historical 

Participating 

F  Test 

P  value 

GT  Score 

M=102.86 

SD=7.47 

N=59 

M=105.33 

SD=13.05 

N=57 

1.58 

>.05 

Go  Percent 

M=94.18 

SD=7.00 

N=59 

M=97.86 

SD=5.00 

N=57 

11.62 

<.05 

Bradley 

Variable 

Historical 

Participating 

F  Test 

P  value 

GT  Score 

M=105.45 

SD=10.17 

N=1 15 

M=103.98 

SD=10.35 

N=85 

1.01 

>.05 

Go  Percent 

M=89.76 

SD=10.35 

N=1 15 

M=93.08 

SD=8.30 

N=85 

10.01 

<.05 

Table  E-2. 

Vehicle  Maintenance  Experience  Item  Statistics 


Question 

Number 


Item 

Description 


Most  Frequent 
Response 


Frequency51, 


1 


Platfonn  confidence 


C 


47.80 


Experience  with  computers 


Routine  Maintenance  On. . . 


Typical  Civilian  Vehicle 


Monthly 


48.10 


42.30 


Fann  Equipment 


Never 


69.60 


Construction  Equipment 


Never 


82.80 


Recreational  Vehicle 


Complex  Maintenance  On. . . 


Typical  Civilian  Vehicle 


Less  Often 


Never 


57.70 


48.10 


Fann  Equipment 


Never 


87.10 


Construction  Equipment 


Never 


90.40 


Recreational  Vehicle 


Routine  Electrical  Work 


Replace  Spark  Plugs 


Never 


Less  Often 


79.70 


32.2 


Dealt  With  Home  Power  Box 


Complex  Electrical  Work 


Replace  Car  Electrical  System 


Never 


Never 


44.40 


71.30 


Use  Diagrams  to  Solve  Problem 


Never 


72.10 


Diagnostic  on  Vehicle 


No 


63.20 


8 


Tech  Manual  Troubleshoot  Vehicle 


No 


67.90 


*Note:  Indicates  percentage  of  responses  represented  by  mode  Respondent  N  =  171. 
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Table  E-3. 

Soldiers  ’  Prior  Knowledge  Summary 


Question 

Number 

Item 

Number/Description 

Mean 

9 

Where  Substantial 
Voltage 

9 

Between  A  &  B 

17.20 

Between  B  &  C 

70.10 

Between  C  &  D 

9.00 

Between  D  &  A 

28.60 

Between  A  &  C 

33.80 

Between  D  &  B 

30.70 

10 

Draw  Circuit 

36.80 

11 

Match  Circuit  & 
Component 

A 

23.40 

B 

50.60 

C 

16.00 

D 

13.50 

E 

24.80 

F 

52.80 

G 

56.60 

H 

48.10 

I 

39.20 

Note:  N  =  171  respondents. 

Mean  =  Percent  correct  responses. 
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Table  E-4. 

Abrams  Correlation  Table 


Go  Pet 

GT  Score 

XP  Index 

PK  Index 

FD 

BM 

CP 

Go  Pet. 

Pearson  r 

1 

.149 

.083 

.223** 

.092 

.086 

.119 

Sig.  (2-tailed) 

.076 

.324 

.007 

.274 

.313 

.168 

N 

160 

142 

143 

143 

142 

141 

136 

GT  Score 

Pearson  r 

.149 

1 

.056 

.367** 

.450** 

.310** 

.349** 

Sig.  (2-tailed) 

.076 

.504 

.000 

.000 

.000 

.000 

N 

142 

149 

142 

142 

142 

142 

137 

XP  Index 

Pearson  r 

.083 

.056 

1 

.248" 

.048 

.018 

.184* 

Sig.  (2-tailed) 

.324 

.504 

.001 

.539 

.816 

.021 

N 

143 

142 

164 

164 

163 

162 

157 

PK  Index 

Pearson  r 

.223” 

.367" 

.248" 

1 

.288** 

.216** 

.221** 

Sig.  (2-tailed) 

.007 

.000 

.001 

.000 

.006 

.005 

N 

143 

142 

164 

164 

163 

162 

157 

FD 

Pearson  r 

.092 

.450" 

.048 

.288" 

1 

.265** 

.314** 

Sig.  (2-tailed) 

.274 

.000 

.539 

.000 

.001 

.000 

142 

142 

163 

163 

163 

162 

157 

N 

.086 

.310" 

.018 

.216** 

.265** 

1 

.265** 

BM 

Pearson  r 

.313 

.000 

.816 

.006 

.001 

.001 

Sig.  (2-tailed) 

141 

142 

162 

162 

162 

162 

157 

N 

.119 

.349" 

.184* 

.221** 

.314** 

.265** 

1 

CP 

Pearson  r 

.168 

.000 

.021 

.005 

.000 

.001 

Sig.  (2-tailed) 

136 

137 

157 

157 

157 

157 

157 

N 

1 

.149 

.083 

.223** 

.092 

.086 

.119 

Note:  Go  Pet.  =  Go  Percent.  XP  Index  =  Experience  Index.  PK  Index  =  Prior  Knowledge  Index.  FD  =  Following 
Directions  Test.  BM  =  Building  Memory  Test.  CP  =  Choosing  a  Path  Test. 

**  Correlation  is  significant  at  the  0.01  level  (2 -tailed). 

*  Correlation  is  significant  at  the  0.05  level  (2 -tailed). 
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Table  E-5. 

Bradley  Control  Correlation  Table 


Go  Pet 

GT  Score 

XP  Index 

PK  Index 

FD 

BM 

CP 

Go  Pet. 

Pearson  r 

1 

.237 

.325* 

.393** 

.186 

.184 

.219 

Sig.  (2-tailed) 

.081 

.018 

.004 

.186 

.197 

.143 

N 

58 

55 

53 

53 

52 

51 

46 

GT  Score 

Pearson  r 

.237 

1 

.233 

.395** 

.395** 

.344* 

.257 

Sig.  (2-tailed) 

.081 

.104 

.005 

.005 

.015 

.088 

N 

55 

55 

50 

50 

50 

50 

45 

XP  Index 

Pearson  r 

.325* 

.233 

1 

.337* 

.188 

.022 

.120 

Sig.  (2-tailed) 

.018 

.104 

.014 

.182 

.877 

.427 

N 

53 

50 

53 

53 

52 

51 

46 

PK  Index 

Pearson  r 

.393** 

.395** 

.337* 

1 

.462** 

.372** 

.160 

Sig.  (2-tailed) 

.004 

.005 

.014 

.001 

.007 

.287 

N 

53 

50 

53 

53 

52 

51 

46 

FD 

Pearson  r 

.186 

.395** 

.188 

.462** 

1 

.238 

.236 

Sig.  (2-tailed) 

.186 

.005 

.182 

.001 

.093 

.115 

52 

50 

52 

52 

52 

51 

46 

N 

.184 

.344* 

.022 

.372** 

.238 

1 

.313* 

BM 

Pearson  r 

.197 

.015 

.877 

.007 

.093 

.034 

Sig.  (2-tailed) 

51 

50 

51 

51 

51 

51 

46 

N 

.219 

.257 

.120 

.160 

.236 

.313* 

1 

CP 

Pearson  r 

.143 

.088 

.427 

.287 

.115 

.034 

Sig.  (2-tailed) 

46 

45 

46 

46 

46 

46 

46 

N 

1 

.237 

.325* 

.393** 

.186 

.184 

.219 

Note:  Go  Pet.  =  Go  Percent.  XP  Index  =  Experience  Index.  PK  Index  =  Prior  Knowledge  Index.  FD  =  Following 
Directions  Test.  BM  =  Building  Memory  Test.  CP  =  Choosing  a  Path  Test. 

**  Correlation  is  significant  at  the  0.01  level  (2-tailed). 

*  Correlation  is  significant  at  the  0.05  level  (2-tailed). 
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Table  E-6. 

Bradley  BRITE  Correlation  Table 


Go  Pet 

GT  Score 

XP  Index 

PK  Index 

FD 

BM 

CP 

Go  Pet. 

Pearson  r 

1 

.001 

-.097 

.157 

.194 

.182 

.102 

Sig.  (2-tailed) 

.996 

.608 

.407 

.304 

.336 

.594 

N 

33 

30 

30 

30 

30 

30 

30 

GT  Score 

Pearson  r 

.001 

1 

.122 

.374 

.525** 

.437* 

.481** 

Sig.  (2-tailed) 

.996 

.537 

.050 

.004 

.020 

.010 

N 

30 

30 

28 

28 

28 

28 

28 

XP  Index 

Pearson  r 

-.097 

.122 

1 

.185 

.220 

.338 

.117 

Sig.  (2-tailed) 

.608 

.537 

.329 

.243 

.068 

.537 

N 

30 

28 

30 

30 

30 

30 

30 

PK  Index 

Pearson  r 

.157 

.374 

.185 

1 

.356 

.360 

.362* 

Sig.  (2-tailed) 

.407 

.050 

.329 

.053 

.051 

.049 

N 

30 

28 

30 

30 

30 

30 

30 

FD 

Pearson  r 

.194 

.525** 

.220 

.356 

1 

.516** 

.669** 

Sig.  (2-tailed) 

.304 

.004 

.243 

.053 

.004 

.000 

30 

28 

30 

30 

30 

30 

30 

N 

.182 

.437* 

.338 

.360 

.516** 

1 

.608** 

BM 

Pearson  r 

.336 

.020 

.068 

.051 

.004 

.000 

Sig.  (2-tailed) 

30 

28 

30 

30 

30 

30 

30 

N 

.102 

.481** 

.117 

.362* 

.669** 

.608** 

1 

CP 

Pearson  r 

.594 

.010 

.537 

.049 

.000 

.000 

Sig.  (2-tailed) 

30 

28 

30 

30 

30 

30 

30 

N 

1 

.001 

-.097 

.157 

.194 

.182 

.102 

Note:  Go  Pet.  =  Go  Percent.  XP  Index  =  Experience  Index.  PK  Index  =  Prior  Knowledge  Index.  FD  =  Following 
Directions  Test.  BM  =  Building  Memory  Test.  CP  =  Choosing  a  Path  Test. 

**  Correlation  is  significant  at  the  0.01  level  (2-tailed). 

*  Correlation  is  significant  at  the  0.05  level  (2-tailed). 

Table  E-7. 

Abrams  Group  Size  Frequency 


Group  Size 

Number 

%  of  Total 

Divided  Small  Group 

477 

75 

Small  Group 

130 

20 

Large  Group 

4 

1 

Half  Class 

1 

0 

Entire  Class 

26 

4 

Totals: 

638 

100 

E-6 


Table  E-8. 

Bradley  Control  Group  Size  Frequency 


Group  Size 

Number 

%  of  Total 

Divided  Small  Group 

152 

71 

Small  Group 

59 

27 

Large  Group 

3 

1 

Half  Class 

1 

0 

Entire  Class 

0 

0 

Totals: 

215 

100 

Table  E-9. 

Bradley  BRITE  Size  Frequency 


Group  Size 

Number 

%  of  Total 

Divided  Small  Group 

9 

7 

Small  Group 

70 

57 

Large  Group 

19 

16 

Half  Class 

17 

14 

Entire  Class 

7 

6 

Totals: 

122 

100 

Table  E-10. 

Instructional  Styles  in  Abrams  Divided  Small  Groups 


Code 

Instructional  Style 

Number 

%  of  Total 

D1 

Demonstration 

2 

0 

D2 

Guided  Demonstration 

10 

3 

GD 

Guided  Discussion 

9 

3 

RC 

Review/reinforce  Content 

17 

5 

LI 

Lecture 

0 

0 

ID 

Informal  Discussion 

9 

3 

PS 

Problem  Solving 

288 

84 

Ot 

Other 

6 

2 

Totals 

341 

100 

E-7 


Table  E-ll. 

Trainer  Interactions  in  Abrams  Divided  Small  Groups 


Code 

Trainer/Instructor 

Number 

%  of  Total 

A 

Asks  question 

17 

15 

P 

Provides  feedback  on  action/performance 

0 

0 

R 

Restates  or  refocuses  the  question/problem 

0 

0 

S 

Directly  answers  the  student’s  question 

0 

0 

E 

Provides  additional  examples 

0 

0 

C 

Reviews  previous/related  content 

3 

3 

L 

Designates  a  task  or  group  leader 

0 

0 

T 

Directs  a  task 

97 

83 

Ot 

Other: 

0 

0 

Totals: 

117 

100 

Table  E-12. 

Student  Interactions  in  Abrams  Divided  Small  Groups 


Code 

Student  Interaction  Codes 

Number 

%  of  Total 

L 

Takes  leadership  role  or  initiative  (w/o  being  directed) 

0 

0 

O 

Offers/provides  help  or  support  to  peer(s) 

331 

5 

A 

Asks  question 

1513 

23 

Q 

Answers  or  responds  to  a  question 

2421 

36 

H 

Accepts  help/support  from  peer(s) 

271 

4 

T 

Completes/attempts  a  directed  task 

1668 

25 

Ot 

Other: 

329 

5 

Totals: 

6681 

100 

Table  E-13. 

Instructional  Styles  in  Bradley  Control  Divided  Small  Groups 


Code 

Instructional  Style 

Number 

%  of  Total 

D1 

Demonstration 

0 

0 

D2 

Guided  Demonstration 

4 

3 

GD 

Guided  Discussion 

0 

0 

RC 

Review/reinforce  Content 

7 

4 

LI 

Lecture 

0 

0 

ID 

Informal  Discussion 

5 

3 

PS 

Problem  Solving 

139 

90 

Ot 

Other 

0 

0 

Totals 

155 

100 

E-8 


Table  E-14. 

Trainer  Interactions  in  Bradley  Control  Divided  Small  Groups 


Code 

Trainer/Instructor 

Number 

%  of  Total 

A 

Asks  question 

68 

33 

P 

Provides  feedback  on  action/performance 

0 

0 

R 

Restates  or  refocuses  the  question/problem 

0 

0 

S 

Directly  answers  the  student’s  question 

0 

0 

E 

Provides  additional  examples 

0 

0 

C 

Reviews  previous/related  content 

50 

24 

L 

Designates  a  task  or  group  leader 

0 

0 

T 

Directs  a  task 

88 

43 

Ot 

Other: 

0 

0 

Totals: 

206 

100 

Table  E-15. 

Student  Interactions  in  Bradley  Control  Divided  Small  Groups 


Code 

Student  Interaction  Codes 

Number 

%  of  Total 

L 

Takes  leadership  role  or  initiative  (w/o  being  directed) 

9 

<1 

O 

Offers/provides  help  or  support  to  peer(s) 

186 

6 

A 

Asks  question 

715 

24 

Q 

Answers  or  responds  to  a  question 

1109 

38 

H 

Accepts  help/support  from  peer(s) 

149 

5 

T 

Completes/attempts  a  directed  task 

758 

26 

Ot 

Other: 

12 

<1 

Totals: 

2938 

100 

Table  E-16. 

Instructional  Styles  in  Bradley  BRITE  Divided  Small  Groups 


Code 

Instructional  Style 

Number 

%  of  Total 

D1 

Demonstration 

0 

0 

D2 

Guided  Demonstration 

0 

0 

GD 

Guided  Discussion 

0 

11 

RC 

Review/reinforce  Content 

0 

0 

LI 

Lecture 

0 

0 

ID 

Informal  Discussion 

0 

0 

PS 

Problem  Solving 

0 

89 

Ot 

Other 

0 

0 

Totals 

9 

100 

E-9 


Table  E-17. 

Trainer  Interactions  in  Bradley  BRITE  Divided  Small  Groups 


Code 

Trainer/Instructor 

Number 

%  of  Total 

A 

Asks  question 

126 

92 

P 

Provides  feedback  on  action/performance 

0 

0 

R 

Restates  or  refocuses  the  question/problem 

0 

0 

S 

Directly  answers  the  student’s  question 

0 

0 

E 

Provides  additional  examples 

0 

0 

C 

Reviews  previous/related  content 

6 

4 

L 

Designates  a  task  or  group  leader 

0 

0 

T 

Directs  a  task 

5 

4 

Ot 

Other: 

0 

0 

Totals: 

137 

100 

Table  E-18. 

Student  Interactions  in  Bradley  BRITE  Divided  Small  Groups 


Code 

Student  Interaction  Codes 

Number 

%  of  Total 

L 

Takes  leadership  role  or  initiative  (w/o  being  directed) 

10 

<1 

O 

Offers/provides  help  or  support  to  peer(s) 

82 

4 

A 

Asks  question 

392 

19 

Q 

Answers  or  responds  to  a  question 

930 

45 

H 

Accepts  help/support  from  peer(s) 

103 

5 

T 

Completes/attempts  a  directed  task 

536 

26 

Ot 

Other: 

0 

0 

Totals: 

2053 

100 

Table  E-19. 

Bradley  BRITE  vs.  Control  Individual  Difference  Comparisons 


Abrams 

Variable 

Bradley  Control 

Bradley  BRITE 

F  Test 

P  value 

GT  Score 

M=102.94 

SD=9.15 

N=50 

M=1 06.29 
SD=1 1.85 
N=28 

1.94 

>.05 

Prior  Knowledge 

M=5.70 

SD=3.86 

N=50 

M=5.61 

SD=5.09 

N=28 

.000 

>.05 

Experience 

M=22.20 

SD=7.38 

N=50 

M=22.21 

SD=7.17 

N=28 

.008 

>.05 

E-10 


Table  E-20. 

Bradley  BRITE  vs.  Control  Individual  Performance  Comparison 


Abrams 

Variable 

Bradley  Control 

Bradley  BRITE 

F  Test 

P  value 

Go  Percent 

M=92.6 

M=93.1 

.06 

>.05 

SD=1.2 

SD=1.6 

N=58 

N=33 

E-ll 


